Apr 14 16:56:57 user devstack@n-api.service[61932]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 14 16:56:57 user devstack@n-api.service[61932]: *** Starting uWSGI 2.0.20-debian (64bit) on [Fri Apr 14 16:56:57 2023] *** Apr 14 16:56:57 user devstack@n-api.service[61932]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 14 16:56:57 user devstack@n-api.service[61932]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 14 16:56:57 user devstack@n-api.service[61932]: nodename: user Apr 14 16:56:57 user devstack@n-api.service[61932]: machine: x86_64 Apr 14 16:56:57 user devstack@n-api.service[61932]: clock source: unix Apr 14 16:56:57 user devstack@n-api.service[61932]: pcre jit disabled Apr 14 16:56:57 user devstack@n-api.service[61932]: detected number of CPU cores: 12 Apr 14 16:56:57 user devstack@n-api.service[61932]: current working directory: / Apr 14 16:56:57 user devstack@n-api.service[61932]: detected binary path: /usr/bin/uwsgi-core Apr 14 16:56:57 user devstack@n-api.service[61932]: your processes number limit is 63637 Apr 14 16:56:57 user devstack@n-api.service[61932]: your memory page size is 4096 bytes Apr 14 16:56:57 user devstack@n-api.service[61932]: detected max file descriptor number: 2048 Apr 14 16:56:57 user devstack@n-api.service[61932]: lock engine: pthread robust mutexes Apr 14 16:56:57 user devstack@n-api.service[61932]: thunder lock: enabled Apr 14 16:56:57 user devstack@n-api.service[61932]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 14 16:56:57 user devstack@n-api.service[61932]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 14 16:56:57 user devstack@n-api.service[61932]: Python main interpreter initialized at 0x564079400990 Apr 14 16:56:57 user devstack@n-api.service[61932]: python threads support enabled Apr 14 16:56:57 user devstack@n-api.service[61932]: your server socket listen backlog is limited to 100 connections Apr 14 16:56:57 user devstack@n-api.service[61932]: your mercy for graceful operations on workers is 90 seconds Apr 14 16:56:57 user devstack@n-api.service[61932]: mapped 537436 bytes (524 KB) for 3 cores Apr 14 16:56:57 user devstack@n-api.service[61932]: *** Operational MODE: preforking *** Apr 14 16:56:57 user devstack@n-api.service[61932]: *** uWSGI is running in multiple interpreter mode *** Apr 14 16:56:57 user devstack@n-api.service[61932]: spawned uWSGI master process (pid: 61932) Apr 14 16:56:57 user devstack@n-api.service[61932]: spawned uWSGI worker 1 (pid: 61933, cores: 1) Apr 14 16:56:57 user devstack@n-api.service[61932]: spawned uWSGI worker 2 (pid: 61934, cores: 1) Apr 14 16:56:57 user devstack@n-api.service[61932]: spawned uWSGI worker 3 (pid: 61935, cores: 1) Apr 14 16:56:57 user devstack@n-api.service[61932]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 14 16:56:57 user devstack@n-api.service[61935]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 16:56:57 user devstack@n-api.service[61933]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 16:56:57 user devstack@n-api.service[61934]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 16:57:01 user devstack@n-api.service[61934]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 16:57:01 user devstack@n-api.service[61934]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 16:57:01 user devstack@n-api.service[61934]: and ``live_migration_inbound_addr`` respectively. Apr 14 16:57:01 user devstack@n-api.service[61934]: ). Its value may be silently ignored in the future. Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 16:57:01 user devstack@n-api.service[61935]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 16:57:01 user devstack@n-api.service[61935]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 16:57:01 user devstack@n-api.service[61935]: and ``live_migration_inbound_addr`` respectively. Apr 14 16:57:01 user devstack@n-api.service[61935]: ). Its value may be silently ignored in the future. Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 16:57:01 user devstack@n-api.service[61933]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 16:57:01 user devstack@n-api.service[61933]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 16:57:01 user devstack@n-api.service[61933]: and ``live_migration_inbound_addr`` respectively. Apr 14 16:57:01 user devstack@n-api.service[61933]: ). Its value may be silently ignored in the future. Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61935) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61934) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61933) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 16:57:01 user devstack@n-api.service[61935]: INFO dbcounter [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] Registered counter for database nova_api Apr 14 16:57:01 user devstack@n-api.service[61933]: INFO dbcounter [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] Registered counter for database nova_api Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG oslo_db.sqlalchemy.engines [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61935) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writer thread running {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG oslo_db.sqlalchemy.engines [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61933) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 16:57:01 user devstack@n-api.service[61934]: INFO dbcounter [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Registered counter for database nova_api Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writer thread running {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG oslo_db.sqlalchemy.engines [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61934) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG nova.context [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7a7c8f85-b2ce-475a-b45c-dad157cd20d9(cell1) {{(pid=61935) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writer thread running {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 16:57:01 user devstack@n-api.service[61935]: INFO dbcounter [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] Registered counter for database nova_cell0 Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG nova.context [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7a7c8f85-b2ce-475a-b45c-dad157cd20d9(cell1) {{(pid=61933) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 16:57:01 user devstack@n-api.service[61935]: INFO dbcounter [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] Registered counter for database nova_cell1 Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG oslo_db.sqlalchemy.engines [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61935) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 16:57:01 user devstack@n-api.service[61933]: INFO dbcounter [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] Registered counter for database nova_cell0 Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG oslo_db.sqlalchemy.engines [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61935) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writer thread running {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 16:57:01 user devstack@n-api.service[61933]: INFO dbcounter [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] Registered counter for database nova_cell1 Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG oslo_db.sqlalchemy.engines [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61933) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writer thread running {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG oslo_db.sqlalchemy.engines [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61933) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG nova.context [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7a7c8f85-b2ce-475a-b45c-dad157cd20d9(cell1) {{(pid=61934) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 16:57:01 user devstack@n-api.service[61934]: INFO dbcounter [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Registered counter for database nova_cell0 Apr 14 16:57:01 user devstack@n-api.service[61934]: INFO dbcounter [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Registered counter for database nova_cell1 Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG oslo_db.sqlalchemy.engines [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61934) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writer thread running {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG oslo_db.sqlalchemy.engines [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61934) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writer thread running {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 16:57:01 user devstack@n-api.service[61935]: INFO dbcounter [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] Registered counter for database nova_cell0 Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG oslo_db.sqlalchemy.engines [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61935) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writer thread running {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 16:57:01 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writer thread running {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 16:57:01 user devstack@n-api.service[61933]: INFO dbcounter [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] Registered counter for database nova_cell0 Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG oslo_db.sqlalchemy.engines [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61933) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 16:57:01 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writer thread running {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writer thread running {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 16:57:01 user devstack@n-api.service[61934]: INFO dbcounter [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Registered counter for database nova_cell0 Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG oslo_db.sqlalchemy.engines [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61934) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 16:57:01 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writer thread running {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 16:57:02 user devstack@n-api.service[61935]: WARNING keystonemiddleware.auth_token [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 16:57:02 user devstack@n-api.service[61935]: WARNING keystonemiddleware.auth_token [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 16:57:02 user devstack@n-api.service[61933]: WARNING keystonemiddleware.auth_token [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 16:57:02 user devstack@n-api.service[61933]: WARNING keystonemiddleware.auth_token [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 16:57:02 user devstack@n-api.service[61935]: WARNING keystonemiddleware.auth_token [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 16:57:02 user devstack@n-api.service[61935]: WARNING keystonemiddleware.auth_token [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 16:57:02 user devstack@n-api.service[61935]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564079400990 pid: 61935 (default app) Apr 14 16:57:02 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:57:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001622 Apr 14 16:57:02 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Fri Apr 14 16:57:02 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:57:02 user devstack@n-api.service[61934]: WARNING keystonemiddleware.auth_token [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 16:57:02 user devstack@n-api.service[61934]: WARNING keystonemiddleware.auth_token [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 16:57:02 user devstack@n-api.service[61933]: WARNING keystonemiddleware.auth_token [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 16:57:02 user devstack@n-api.service[61933]: WARNING keystonemiddleware.auth_token [None req-cacd2ff8-c172-4e53-8394-06ba8e151fc1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 16:57:02 user devstack@n-api.service[61933]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564079400990 pid: 61933 (default app) Apr 14 16:57:02 user devstack@n-api.service[61934]: WARNING keystonemiddleware.auth_token [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 16:57:02 user devstack@n-api.service[61934]: WARNING keystonemiddleware.auth_token [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 16:57:02 user devstack@n-api.service[61934]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564079400990 pid: 61934 (default app) Apr 14 16:59:13 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:59:13 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-40cf1509-4bef-4073-83f6-50083575d42b None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001571 Apr 14 16:59:13 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 16:59:13 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:59:13 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=3 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:59:13 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=3 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:59:13 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=3 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:59:13 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=3 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:59:14 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-7e84cdc3-af0f-48af-a8b8-ca1165b30275 admin admin] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:59:14 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-7e84cdc3-af0f-48af-a8b8-ca1165b30275 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.386392 Apr 14 16:59:14 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 16:59:13 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:59:16 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:59:16 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002380 Apr 14 16:59:16 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 16:59:16 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:59:16 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=3 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:59:16 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=3 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:59:16 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=3 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:59:16 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:59:16 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-262ff9a9-ec7a-4660-97c8-b11a70a83490 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:16 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-262ff9a9-ec7a-4660-97c8-b11a70a83490 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.317407 Apr 14 16:59:16 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 16:59:16 2023] POST /compute/v2.1/flavors => generated 405 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:59:16 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-acdf517d-a44d-41cf-839e-d7c93edc77eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:16 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-acdf517d-a44d-41cf-839e-d7c93edc77eb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100002 Apr 14 16:59:16 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 16:59:16 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:59:18 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:59:18 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001345 Apr 14 16:59:18 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 16:59:18 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 16:59:18 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-9bd41ffe-1299-4361-b1b7-1c055f01e1fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "swap": 0, "disk": 5, "id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "os-flavor-access:is_public": true}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:18 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-9bd41ffe-1299-4361-b1b7-1c055f01e1fb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.062437 Apr 14 16:59:18 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 16:59:18 2023] POST /compute/v2.1/flavors => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:59:18 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-7d0398ff-58e0-476e-8bc9-73da37002356 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:18 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-7d0398ff-58e0-476e-8bc9-73da37002356 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032946 Apr 14 16:59:18 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 16:59:18 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:59:20 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:59:20 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001351 Apr 14 16:59:20 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 16:59:20 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:59:20 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-3a4f5c0d-1dba-4a47-8cb3-d39b12343ff6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "id": "d2", "ram": 1024}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:20 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-3a4f5c0d-1dba-4a47-8cb3-d39b12343ff6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.061799 Apr 14 16:59:20 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 16:59:20 2023] POST /compute/v2.1/flavors => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:59:20 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-e025db6f-9576-4459-9901-9a042b91cdfc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:20 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-e025db6f-9576-4459-9901-9a042b91cdfc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028810 Apr 14 16:59:20 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 16:59:20 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:59:22 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:59:22 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002399 Apr 14 16:59:22 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 16:59:22 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:59:22 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-42ac04f6-b354-4cf3-8f1b-b7c6012cf161 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "rxtx_factor": 1.0, "id": "d3", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:22 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-42ac04f6-b354-4cf3-8f1b-b7c6012cf161 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.068865 Apr 14 16:59:22 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 16:59:22 2023] POST /compute/v2.1/flavors => generated 402 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:59:22 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-40065c31-193a-4bfc-8786-ab674f08264d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:22 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-40065c31-193a-4bfc-8786-ab674f08264d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035384 Apr 14 16:59:22 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 16:59:22 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:59:24 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:59:24 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001487 Apr 14 16:59:24 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 16:59:24 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:59:24 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-42f326bc-dce2-43e1-9264-818d2449ef4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4", "name": "ds4G"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:24 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-42f326bc-dce2-43e1-9264-818d2449ef4e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.057680 Apr 14 16:59:24 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 16:59:24 2023] POST /compute/v2.1/flavors => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:59:24 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d5e23e7c-82f0-4bf9-981e-b45362666162 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:24 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d5e23e7c-82f0-4bf9-981e-b45362666162 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029262 Apr 14 16:59:24 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 16:59:24 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:59:26 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:59:26 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-08789bbb-b667-4ab0-9d7c-551d0c5cc437 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001411 Apr 14 16:59:26 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 16:59:26 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:59:26 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-d3600c7e-7602-4a83-adb0-dec96b280761 admin admin] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:59:26 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-d3600c7e-7602-4a83-adb0-dec96b280761 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.070873 Apr 14 16:59:26 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 16:59:26 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 16:59:28 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d5e23e7c-82f0-4bf9-981e-b45362666162 admin admin] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:59:28 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d5e23e7c-82f0-4bf9-981e-b45362666162 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001959 Apr 14 16:59:28 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 16:59:28 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:59:28 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=3 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:59:28 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=3 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:59:28 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=3 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:59:28 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=3 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 16:59:29 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-20066605-4fcd-4462-97d0-d922b58108ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:29 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-20066605-4fcd-4462-97d0-d922b58108ad admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.321620 Apr 14 16:59:29 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 16:59:28 2023] POST /compute/v2.1/flavors => generated 400 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:59:29 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a243170a-6008-48b1-a87e-4afee602b987 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:29 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-a243170a-6008-48b1-a87e-4afee602b987 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034353 Apr 14 16:59:29 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 16:59:29 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:59:31 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d5e23e7c-82f0-4bf9-981e-b45362666162 admin admin] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:59:31 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d5e23e7c-82f0-4bf9-981e-b45362666162 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001298 Apr 14 16:59:31 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 16:59:31 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:59:31 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-1318055f-c1de-48f6-99d7-43ce7914ebfa admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "ram": 2048, "vcpus": 1, "id": "2"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:31 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-1318055f-c1de-48f6-99d7-43ce7914ebfa admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.076507 Apr 14 16:59:31 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 16:59:31 2023] POST /compute/v2.1/flavors => generated 403 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:59:31 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-82fc0e66-5917-4fca-9e27-aa4739120072 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:31 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-82fc0e66-5917-4fca-9e27-aa4739120072 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025675 Apr 14 16:59:31 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 16:59:31 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:59:33 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d5e23e7c-82f0-4bf9-981e-b45362666162 admin admin] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:59:33 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d5e23e7c-82f0-4bf9-981e-b45362666162 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001312 Apr 14 16:59:33 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 16:59:33 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:59:33 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-b4fa078c-f3f9-4396-aa06-5af26b649168 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "ram": 4096, "id": "3", "swap": 0}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:33 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-b4fa078c-f3f9-4396-aa06-5af26b649168 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.099541 Apr 14 16:59:33 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 16:59:33 2023] POST /compute/v2.1/flavors => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:59:33 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-5abe6449-e643-418b-a683-4da7f498f9ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:33 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-5abe6449-e643-418b-a683-4da7f498f9ec admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024661 Apr 14 16:59:33 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 16:59:33 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:59:35 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d5e23e7c-82f0-4bf9-981e-b45362666162 admin admin] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:59:35 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d5e23e7c-82f0-4bf9-981e-b45362666162 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001379 Apr 14 16:59:35 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 16:59:35 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:59:35 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-de279e0c-f6f0-4ae0-b63e-afb019610b3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "disk": 80, "os-flavor-access:is_public": true, "id": "4"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:35 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-de279e0c-f6f0-4ae0-b63e-afb019610b3f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.088505 Apr 14 16:59:35 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 16:59:35 2023] POST /compute/v2.1/flavors => generated 403 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:59:35 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-ed13a82a-130e-4dba-a503-d83e6b215aeb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:35 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-ed13a82a-130e-4dba-a503-d83e6b215aeb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033318 Apr 14 16:59:35 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 16:59:35 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 16:59:37 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d5e23e7c-82f0-4bf9-981e-b45362666162 admin admin] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 16:59:37 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d5e23e7c-82f0-4bf9-981e-b45362666162 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002172 Apr 14 16:59:37 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 16:59:37 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 16:59:37 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-b8e644c0-f899-4132-8edf-9cd031195e6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 160, "vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:37 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-b8e644c0-f899-4132-8edf-9cd031195e6d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.062438 Apr 14 16:59:37 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 16:59:37 2023] POST /compute/v2.1/flavors => generated 406 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 16:59:37 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-3ac4b4d1-15e9-46f9-9125-1009bacf9571 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 16:59:37 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-3ac4b4d1-15e9-46f9-9125-1009bacf9571 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025989 Apr 14 16:59:37 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 16:59:37 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:00:08 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d5e23e7c-82f0-4bf9-981e-b45362666162 admin admin] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:00:08 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d5e23e7c-82f0-4bf9-981e-b45362666162 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001751 Apr 14 17:00:08 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 17:00:08 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:00:08 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:00:08 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-65f5f1b4-6078-4fdc-8072-475450ad86c3 admin admin] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:00:08 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-65f5f1b4-6078-4fdc-8072-475450ad86c3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:00:08 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-65f5f1b4-6078-4fdc-8072-475450ad86c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:00:08 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-65f5f1b4-6078-4fdc-8072-475450ad86c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:00:08 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-65f5f1b4-6078-4fdc-8072-475450ad86c3 admin admin] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:00:08 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-65f5f1b4-6078-4fdc-8072-475450ad86c3 admin admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:00:08 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-65f5f1b4-6078-4fdc-8072-475450ad86c3 admin admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:00:08 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-65f5f1b4-6078-4fdc-8072-475450ad86c3 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.099396 Apr 14 17:00:08 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Fri Apr 14 17:00:08 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 17:00:41 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-3ac4b4d1-15e9-46f9-9125-1009bacf9571 admin admin] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:00:41 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-3ac4b4d1-15e9-46f9-9125-1009bacf9571 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002228 Apr 14 17:00:41 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 17:00:41 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:00:41 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:00:41 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-39797e66-dfb2-409e-8698-5d87bce5e639 admin admin] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:00:41 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-39797e66-dfb2-409e-8698-5d87bce5e639 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.074545 Apr 14 17:00:41 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Fri Apr 14 17:00:41 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:00:45 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-65f5f1b4-6078-4fdc-8072-475450ad86c3 admin admin] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:00:45 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-65f5f1b4-6078-4fdc-8072-475450ad86c3 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001709 Apr 14 17:00:45 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 17:00:45 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:00:45 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:00:45 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-8b150d24-d673-4348-9cd3-9cb7b03a77ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 128, "rxtx_factor": 1.0, "name": "m1.nano", "swap": 0, "disk": 1, "id": "42", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:00:45 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-8b150d24-d673-4348-9cd3-9cb7b03a77ca admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.069026 Apr 14 17:00:45 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 17:00:45 2023] POST /compute/v2.1/flavors => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 17:00:45 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-eb1aa581-7a65-4776-97f7-0afea6773a2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:00:45 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-eb1aa581-7a65-4776-97f7-0afea6773a2b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024739 Apr 14 17:00:45 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 17:00:45 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:00:49 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-65f5f1b4-6078-4fdc-8072-475450ad86c3 admin admin] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:00:49 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-65f5f1b4-6078-4fdc-8072-475450ad86c3 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002475 Apr 14 17:00:49 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 17:00:49 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:00:49 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-1a0fdae5-6489-41b7-ad38-a58f402fb135 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 192, "id": "84", "rxtx_factor": 1.0, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.micro", "vcpus": 1}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:00:49 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-1a0fdae5-6489-41b7-ad38-a58f402fb135 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071117 Apr 14 17:00:49 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 17:00:49 2023] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 17:00:49 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-e2ec30e3-80b7-4506-9b01-02897c4224a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:00:49 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-e2ec30e3-80b7-4506-9b01-02897c4224a3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025207 Apr 14 17:00:49 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 17:00:49 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:03:20 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:20 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:20 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:20 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-415cc859-d1ad-45d3-979c-ed4f3a509bb9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Action: 'create', calling method: .version_select at 0x7fe19dea29e0>, body: {"keypair": {"name": "tempest-keypair-425177179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMFX3PNhmn48zAcAM32FCi6I37xeoBXmvNkQF9+BlyxoC3Wt0VKiGtT8+ZV4F3wVaRtE4tHpycwzfuy8U0QMx+VsAblObJ2Jwl7GhaAEZfytnLGzIAsPxYRqQiYBh5Ikg=="}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:20 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-415cc859-d1ad-45d3-979c-ed4f3a509bb9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting quotas for project 6f341a2096b9483787b569a59f325556. Resources: {'key_pairs'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:03:20 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-415cc859-d1ad-45d3-979c-ed4f3a509bb9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting quotas for user d9c9e0d318eb4ca49d47d620682fb00a and project 6f341a2096b9483787b569a59f325556. Resources: {'key_pairs'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:03:20 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-415cc859-d1ad-45d3-979c-ed4f3a509bb9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.319741 Apr 14 17:03:20 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 17:03:20 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:03:22 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:22 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a5161a0e-9390-44bf-a77b-26bc2eeb867f tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Action: 'create', calling method: .version_select at 0x7fe19de4a4d0>, body: {"keypair": {"name": "tempest-keypair-953990957", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN+4su9x0TwogopEsyk2cXibSCUi8mH3gHWHapdKBKHYqrYfJpS8WOcRJLD6flUaVZBaj2p/Sm6e00w/dkBvtdCZ+9NN9jGlOAUYf18G8LS3fUB1URMTncNbQD/aeLXbA=="}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:22 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-a5161a0e-9390-44bf-a77b-26bc2eeb867f tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Getting quotas for project 0c8f6b39515e456c9f5a1affa9f79000. Resources: {'key_pairs'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:03:22 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-a5161a0e-9390-44bf-a77b-26bc2eeb867f tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Getting quotas for user d7c4734925f645248b0f9060aa78a502 and project 0c8f6b39515e456c9f5a1affa9f79000. Resources: {'key_pairs'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:03:22 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-a5161a0e-9390-44bf-a77b-26bc2eeb867f tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.313108 Apr 14 17:03:22 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 17:03:22 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:03:25 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:25 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-304489661", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "06f3eb05-9ead-4131-b955-af3bc09e9758"}], "security_groups": [{"name": "tempest-securitygroup--446156484"}], "key_name": "tempest-keypair-425177179", "user_data": "}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:26 user devstack@n-api.service[61933]: DEBUG nova.network.neutron [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] validate_networks() for [('06f3eb05-9ead-4131-b955-af3bc09e9758', None, None, None, None, None)] {{(pid=61933) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:03:27 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-279445092", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "networks": [{"uuid": "bba4f725-673c-4e1a-a5bb-a435afc40332"}]}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:27 user devstack@n-api.service[61934]: DEBUG nova.network.neutron [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] validate_networks() for [('bba4f725-673c-4e1a-a5bb-a435afc40332', None, None, None, None, None)] {{(pid=61934) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:03:28 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1946928573", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ae8c914e-554e-4cdf-b176-7ede005eb4f6"}], "security_groups": [{"name": "tempest-securitygroup--663817505"}], "key_name": "tempest-keypair-953990957", "user_data": "}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:28 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:03:28 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:03:28 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:03:28 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:03:28 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:03:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:28 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Getting quotas for project 426156fb00db428683851cf731b680d1. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:03:28 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Getting quotas for user 0d1ea0218b044c1e94f61a07c1d14a75 and project 426156fb00db428683851cf731b680d1. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:03:28 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Going to run 1 instances... {{(pid=61934) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:03:28 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:03:28 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-39b31248-a154-4a2c-a79d-7206b548576a tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.765769 Apr 14 17:03:28 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:03:27 2023] POST /compute/v2.1/servers => generated 378 bytes in 1768 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:03:28 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a783a68d-522b-40f8-94e5-b4e4c2df1978 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:03:28 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-a783a68d-522b-40f8-94e5-b4e4c2df1978 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:03:28 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-a783a68d-522b-40f8-94e5-b4e4c2df1978 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1ea0218b044c1e94f61a07c1d14a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426156fb00db428683851cf731b680d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:03:28 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-a783a68d-522b-40f8-94e5-b4e4c2df1978 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d" status: 200 len: 1210 microversion: 2.1 time: 0.138861 Apr 14 17:03:28 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 17/49] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:03:28 2023] GET /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d => generated 1210 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:03:29 user devstack@n-api.service[61935]: DEBUG nova.network.neutron [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] validate_networks() for [('ae8c914e-554e-4cdf-b176-7ede005eb4f6', None, None, None, None, None)] {{(pid=61935) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:03:29 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flavor limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:03:29 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Image limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:03:29 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flavor pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:03:29 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Image pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:03:29 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:03:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:29 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting quotas for project 6f341a2096b9483787b569a59f325556. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:03:29 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting quotas for user d9c9e0d318eb4ca49d47d620682fb00a and project 6f341a2096b9483787b569a59f325556. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:03:29 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Going to run 1 instances... {{(pid=61933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:03:29 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:03:29 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1168352709", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "networks": [{"uuid": "0551b00c-c92d-4d9c-affc-e9f25a64ed9a"}]}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:29 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-3d2013ce-5d70-497d-a866-4493dc9b452e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 4.157752 Apr 14 17:03:29 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 16/50] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:03:25 2023] POST /compute/v2.1/servers => generated 399 bytes in 4160 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 14 17:03:29 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-df9aeb29-ea33-41a0-b5f1-5dd352fc4dc2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:03:29 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-df9aeb29-ea33-41a0-b5f1-5dd352fc4dc2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:03:29 user devstack@n-api.service[61934]: DEBUG nova.network.neutron [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] validate_networks() for [('0551b00c-c92d-4d9c-affc-e9f25a64ed9a', None, None, None, None, None)] {{(pid=61934) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:03:30 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-df9aeb29-ea33-41a0-b5f1-5dd352fc4dc2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c9e0d318eb4ca49d47d620682fb00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f341a2096b9483787b569a59f325556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:03:30 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-df9aeb29-ea33-41a0-b5f1-5dd352fc4dc2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1" status: 200 len: 1234 microversion: 2.1 time: 0.248536 Apr 14 17:03:30 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:03:29 2023] GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1 => generated 1234 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:03:30 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Flavor limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:03:30 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Image limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:03:30 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Flavor pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:03:30 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Image pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:03:30 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:03:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:30 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Getting quotas for project 0c8f6b39515e456c9f5a1affa9f79000. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:03:30 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Getting quotas for user d7c4734925f645248b0f9060aa78a502 and project 0c8f6b39515e456c9f5a1affa9f79000. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:03:30 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Going to run 1 instances... {{(pid=61935) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:03:30 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:03:30 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-1e52d4d2-7b07-4127-90aa-9c0c1b52f287 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Action: 'create', calling method: .version_select at 0x7fe19dda37f0>, body: {"keypair": {"name": "tempest-keypair-1270943457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzVLXKTMjj+oWgl5UjeCg470ILAsgtQRYzCsqgruNLBE9s509BMvlpfzsOb9vynIrkGPbYSSRskFS/m1TTup2eransCsvDdeWR+bzlyn30Rn6MOx9JQq0u/nbPnQu7vxQ=="}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:30 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-1e52d4d2-7b07-4127-90aa-9c0c1b52f287 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Getting quotas for project 7fa2764eee6c4071b5607f78762ca653. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:03:30 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-1e52d4d2-7b07-4127-90aa-9c0c1b52f287 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Getting quotas for user 1d67df67ba8e4905bf7c6545c5748a41 and project 7fa2764eee6c4071b5607f78762ca653. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:03:30 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-1a975062-d163-40cb-afeb-3a897fb14ecb tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.570235 Apr 14 17:03:30 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 18/52] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:03:28 2023] POST /compute/v2.1/servers => generated 399 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:03:30 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-6d18946f-85fc-482b-90bf-61a303f95c14 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:03:30 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-6d18946f-85fc-482b-90bf-61a303f95c14 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:03:30 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-1e52d4d2-7b07-4127-90aa-9c0c1b52f287 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.196057 Apr 14 17:03:30 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 18/53] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 17:03:30 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:03:30 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-6d18946f-85fc-482b-90bf-61a303f95c14 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c4734925f645248b0f9060aa78a502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8f6b39515e456c9f5a1affa9f79000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:03:30 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-6d18946f-85fc-482b-90bf-61a303f95c14 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97" status: 200 len: 1231 microversion: 2.1 time: 0.150054 Apr 14 17:03:30 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 19/54] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:03:30 2023] GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97 => generated 1231 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:03:31 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:03:31 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:03:31 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:03:31 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:03:31 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:03:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:31 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Getting quotas for project 762a37326f89466c9ee3714ea2e2e905. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:03:31 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Getting quotas for user 740d636ab92c4700b480ea58ce6a30ff and project 762a37326f89466c9ee3714ea2e2e905. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:03:31 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Going to run 1 instances... {{(pid=61934) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:03:31 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:03:31 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-675ede17-9154-47a7-871c-6f681dc3a4e7 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.708393 Apr 14 17:03:31 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 18/55] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:03:29 2023] POST /compute/v2.1/servers => generated 378 bytes in 1713 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 14 17:03:31 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-59f2693b-e6ae-4eb8-b692-4c7dc8965dee tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:03:31 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-59f2693b-e6ae-4eb8-b692-4c7dc8965dee tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:03:31 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-59f2693b-e6ae-4eb8-b692-4c7dc8965dee tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d636ab92c4700b480ea58ce6a30ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762a37326f89466c9ee3714ea2e2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:03:31 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-59f2693b-e6ae-4eb8-b692-4c7dc8965dee tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e" status: 200 len: 1209 microversion: 2.1 time: 0.126057 Apr 14 17:03:31 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 19/56] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:03:31 2023] GET /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e => generated 1209 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:03:36 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-c3c6d7c3-ed5f-4e4a-9f56-7c5c05e3bd90 req-fdab3ff1-b30b-4ec7-818c-4f41ae848832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed9bc80-9e7d-4de9-ac86-704c927b111d", "tag": "0b4fc330-8a13-4916-b3be-16398b46bec1"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c3c6d7c3-ed5f-4e4a-9f56-7c5c05e3bd90 req-fdab3ff1-b30b-4ec7-818c-4f41ae848832 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c3c6d7c3-ed5f-4e4a-9f56-7c5c05e3bd90 req-fdab3ff1-b30b-4ec7-818c-4f41ae848832 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c3c6d7c3-ed5f-4e4a-9f56-7c5c05e3bd90 req-fdab3ff1-b30b-4ec7-818c-4f41ae848832 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:36 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c3c6d7c3-ed5f-4e4a-9f56-7c5c05e3bd90 req-fdab3ff1-b30b-4ec7-818c-4f41ae848832 service nova] Creating event network-changed:0b4fc330-8a13-4916-b3be-16398b46bec1 for instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d on user Apr 14 17:03:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c3c6d7c3-ed5f-4e4a-9f56-7c5c05e3bd90 req-fdab3ff1-b30b-4ec7-818c-4f41ae848832 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61935) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 17:03:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c3c6d7c3-ed5f-4e4a-9f56-7c5c05e3bd90 req-fdab3ff1-b30b-4ec7-818c-4f41ae848832 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61935) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 17:03:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-14469422-9440-4976-adfa-a9322da4292a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-14469422-9440-4976-adfa-a9322da4292a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-14469422-9440-4976-adfa-a9322da4292a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-14469422-9440-4976-adfa-a9322da4292a None None] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-14469422-9440-4976-adfa-a9322da4292a None None] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-14469422-9440-4976-adfa-a9322da4292a None None] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:36 user devstack@n-api.service[61935]: INFO nova.compute.rpcapi [None req-14469422-9440-4976-adfa-a9322da4292a None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 17:03:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-14469422-9440-4976-adfa-a9322da4292a None None] Releasing lock "compute-rpcapi-router" {{(pid=61935) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 17:03:36 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-14469422-9440-4976-adfa-a9322da4292a None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213963 Apr 14 17:03:36 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 20/57] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:03:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:03:38 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-74d24e94-ccfa-4c5c-8706-27df05ed1fe5 req-015b42d2-80c4-48f3-bd97-6ca40eb064d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0488788-7b88-4c48-9fcd-02640c09feb1", "tag": "adb6bafa-17f9-4c4e-af68-632cc59c3a03"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-74d24e94-ccfa-4c5c-8706-27df05ed1fe5 req-015b42d2-80c4-48f3-bd97-6ca40eb064d5 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-74d24e94-ccfa-4c5c-8706-27df05ed1fe5 req-015b42d2-80c4-48f3-bd97-6ca40eb064d5 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-74d24e94-ccfa-4c5c-8706-27df05ed1fe5 req-015b42d2-80c4-48f3-bd97-6ca40eb064d5 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:38 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-74d24e94-ccfa-4c5c-8706-27df05ed1fe5 req-015b42d2-80c4-48f3-bd97-6ca40eb064d5 service nova] Creating event network-changed:adb6bafa-17f9-4c4e-af68-632cc59c3a03 for instance c0488788-7b88-4c48-9fcd-02640c09feb1 on user Apr 14 17:03:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-74d24e94-ccfa-4c5c-8706-27df05ed1fe5 req-015b42d2-80c4-48f3-bd97-6ca40eb064d5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61934) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 17:03:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-74d24e94-ccfa-4c5c-8706-27df05ed1fe5 req-015b42d2-80c4-48f3-bd97-6ca40eb064d5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61934) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 17:03:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-19b9dd62-dd95-47b1-875e-b8225d901f18 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-19b9dd62-dd95-47b1-875e-b8225d901f18 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-19b9dd62-dd95-47b1-875e-b8225d901f18 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-19b9dd62-dd95-47b1-875e-b8225d901f18 None None] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-19b9dd62-dd95-47b1-875e-b8225d901f18 None None] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-19b9dd62-dd95-47b1-875e-b8225d901f18 None None] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:38 user devstack@n-api.service[61934]: INFO nova.compute.rpcapi [None req-19b9dd62-dd95-47b1-875e-b8225d901f18 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 17:03:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-19b9dd62-dd95-47b1-875e-b8225d901f18 None None] Releasing lock "compute-rpcapi-router" {{(pid=61934) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 17:03:38 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-19b9dd62-dd95-47b1-875e-b8225d901f18 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181149 Apr 14 17:03:38 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 19/58] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:03:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:03:38 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1113450813", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "networks": [{"uuid": "37fa35e6-fef6-4271-b78f-d6ab8c37ad0e"}], "security_groups": [{"name": "tempest-securitygroup--828881137"}], "key_name": "tempest-keypair-1270943457", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:39 user devstack@n-api.service[61933]: DEBUG nova.network.neutron [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] validate_networks() for [('37fa35e6-fef6-4271-b78f-d6ab8c37ad0e', None, None, None, None, None)] {{(pid=61933) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:03:39 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:39 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:40 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=12 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:40 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-b97ea6e1-bbf7-42dd-86c2-68c697266863 req-76fe8105-001f-427d-9011-b5ce759a79ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e707b44-e838-4494-9fbc-5698e755e09e", "tag": "5572c41c-64e8-4058-9a5e-f3a994e78787"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-b97ea6e1-bbf7-42dd-86c2-68c697266863 req-76fe8105-001f-427d-9011-b5ce759a79ac service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-b97ea6e1-bbf7-42dd-86c2-68c697266863 req-76fe8105-001f-427d-9011-b5ce759a79ac service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-b97ea6e1-bbf7-42dd-86c2-68c697266863 req-76fe8105-001f-427d-9011-b5ce759a79ac service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:40 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-b97ea6e1-bbf7-42dd-86c2-68c697266863 req-76fe8105-001f-427d-9011-b5ce759a79ac service nova] Creating event network-changed:5572c41c-64e8-4058-9a5e-f3a994e78787 for instance 6e707b44-e838-4494-9fbc-5698e755e09e on user Apr 14 17:03:40 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-b97ea6e1-bbf7-42dd-86c2-68c697266863 req-76fe8105-001f-427d-9011-b5ce759a79ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087361 Apr 14 17:03:40 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 21/59] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:03:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:03:40 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Flavor limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:03:40 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Image limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:03:40 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Flavor pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:03:40 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Image pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:03:40 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:03:40 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:40 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:40 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:40 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:40 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:40 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:40 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Getting quotas for project 7fa2764eee6c4071b5607f78762ca653. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:03:40 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Getting quotas for user 1d67df67ba8e4905bf7c6545c5748a41 and project 7fa2764eee6c4071b5607f78762ca653. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:03:40 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Going to run 1 instances... {{(pid=61933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:03:40 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:03:40 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-b17afdb7-0d18-4018-9704-da76be3c55fd req-c3a482f8-899c-416e-9e5b-5d88a2558c92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:40 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b17afdb7-0d18-4018-9704-da76be3c55fd req-c3a482f8-899c-416e-9e5b-5d88a2558c92 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:40 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b17afdb7-0d18-4018-9704-da76be3c55fd req-c3a482f8-899c-416e-9e5b-5d88a2558c92 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:40 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b17afdb7-0d18-4018-9704-da76be3c55fd req-c3a482f8-899c-416e-9e5b-5d88a2558c92 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:40 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-fc52f697-e8b7-43a2-adfb-29514334e574 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.233490 Apr 14 17:03:40 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 20/60] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:03:38 2023] POST /compute/v2.1/servers => generated 403 bytes in 2235 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:03:40 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-b17afdb7-0d18-4018-9704-da76be3c55fd req-c3a482f8-899c-416e-9e5b-5d88a2558c92 service nova] Creating event network-changed:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:03:41 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-b17afdb7-0d18-4018-9704-da76be3c55fd req-c3a482f8-899c-416e-9e5b-5d88a2558c92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095301 Apr 14 17:03:41 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-16125383-7a1f-45fc-b5e8-91c6dfe84fcb tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:03:41 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 20/61] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:03:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:03:41 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-16125383-7a1f-45fc-b5e8-91c6dfe84fcb tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:03:41 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-16125383-7a1f-45fc-b5e8-91c6dfe84fcb tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d67df67ba8e4905bf7c6545c5748a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2764eee6c4071b5607f78762ca653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:03:41 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-16125383-7a1f-45fc-b5e8-91c6dfe84fcb tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd" status: 200 len: 1240 microversion: 2.1 time: 0.154634 Apr 14 17:03:41 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 22/62] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:03:40 2023] GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd => generated 1240 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:03:43 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-e6f7ccd4-3b72-418a-b984-440a240b9fec tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Action: 'create', calling method: .version_select at 0x7fe19ddead40>, body: {"keypair": {"name": "tempest-keypair-1620409315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFR1CNYcMSCZc5eqIUYpiiSdLTZSUbTWdwUiOhkSwjDpbWuIjOlJMXY2cpa5eWTlS2m8+qE/dME0iLvbqEAefO3EiObUhqvYCxqX/rY9WZyKZyz8bSdRk67t79mPKSlZeQ=="}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:43 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-e6f7ccd4-3b72-418a-b984-440a240b9fec tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Getting quotas for project 5c8f41946e544d0c93cbceb3d03e50a5. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:03:43 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-e6f7ccd4-3b72-418a-b984-440a240b9fec tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Getting quotas for user 01d0e8ec192748edbe2576ef1c1e1cb5 and project 5c8f41946e544d0c93cbceb3d03e50a5. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:03:43 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-e6f7ccd4-3b72-418a-b984-440a240b9fec tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.252024 Apr 14 17:03:43 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 21/63] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 17:03:42 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:03:46 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=18 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:46 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-394aa4cb-6372-4687-8c02-835aff0737b9 req-ab66fee3-2ae5-4c1c-8cf8-4cff7e531142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed9bc80-9e7d-4de9-ac86-704c927b111d", "name": "network-vif-plugged", "status": "completed", "tag": "0b4fc330-8a13-4916-b3be-16398b46bec1"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-394aa4cb-6372-4687-8c02-835aff0737b9 req-ab66fee3-2ae5-4c1c-8cf8-4cff7e531142 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-394aa4cb-6372-4687-8c02-835aff0737b9 req-ab66fee3-2ae5-4c1c-8cf8-4cff7e531142 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-394aa4cb-6372-4687-8c02-835aff0737b9 req-ab66fee3-2ae5-4c1c-8cf8-4cff7e531142 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:46 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-394aa4cb-6372-4687-8c02-835aff0737b9 req-ab66fee3-2ae5-4c1c-8cf8-4cff7e531142 service nova] Creating event network-vif-plugged:0b4fc330-8a13-4916-b3be-16398b46bec1 for instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d on user Apr 14 17:03:46 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-394aa4cb-6372-4687-8c02-835aff0737b9 req-ab66fee3-2ae5-4c1c-8cf8-4cff7e531142 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039504 Apr 14 17:03:46 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 21/64] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:03:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:03:46 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-cadc3cd9-7e3f-42a4-ab17-d401506d07b1 req-fd0e7931-bd90-4e19-8303-112f67e239c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0488788-7b88-4c48-9fcd-02640c09feb1", "name": "network-vif-plugged", "status": "completed", "tag": "adb6bafa-17f9-4c4e-af68-632cc59c3a03"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-cadc3cd9-7e3f-42a4-ab17-d401506d07b1 req-fd0e7931-bd90-4e19-8303-112f67e239c4 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-cadc3cd9-7e3f-42a4-ab17-d401506d07b1 req-fd0e7931-bd90-4e19-8303-112f67e239c4 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-cadc3cd9-7e3f-42a4-ab17-d401506d07b1 req-fd0e7931-bd90-4e19-8303-112f67e239c4 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:46 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-cadc3cd9-7e3f-42a4-ab17-d401506d07b1 req-fd0e7931-bd90-4e19-8303-112f67e239c4 service nova] Creating event network-vif-plugged:adb6bafa-17f9-4c4e-af68-632cc59c3a03 for instance c0488788-7b88-4c48-9fcd-02640c09feb1 on user Apr 14 17:03:46 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-cadc3cd9-7e3f-42a4-ab17-d401506d07b1 req-fd0e7931-bd90-4e19-8303-112f67e239c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033772 Apr 14 17:03:46 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 23/65] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:03:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:03:48 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed9bc80-9e7d-4de9-ac86-704c927b111d", "name": "network-vif-plugged", "status": "completed", "tag": "0b4fc330-8a13-4916-b3be-16398b46bec1"}, {"name": "network-changed", "server_uuid": "d5920661-9030-4cf7-88a0-1ad789eec1bd", "tag": "526282d7-c5ce-4ae0-9745-4e43477222f0"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:48 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] Creating event network-vif-plugged:0b4fc330-8a13-4916-b3be-16398b46bec1 for instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d on user Apr 14 17:03:48 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] Creating event network-changed:526282d7-c5ce-4ae0-9745-4e43477222f0 for instance d5920661-9030-4cf7-88a0-1ad789eec1bd on user Apr 14 17:03:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61933) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 17:03:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-39827152-15bf-4479-95a4-5377788335bd req-5e47c976-2f4e-4836-8198-53f9ef004dd9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61933) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 17:03:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4c862a1c-1a69-44ed-90e2-b5484928f87e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4c862a1c-1a69-44ed-90e2-b5484928f87e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4c862a1c-1a69-44ed-90e2-b5484928f87e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4c862a1c-1a69-44ed-90e2-b5484928f87e None None] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4c862a1c-1a69-44ed-90e2-b5484928f87e None None] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4c862a1c-1a69-44ed-90e2-b5484928f87e None None] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:48 user devstack@n-api.service[61933]: INFO nova.compute.rpcapi [None req-4c862a1c-1a69-44ed-90e2-b5484928f87e None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 17:03:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4c862a1c-1a69-44ed-90e2-b5484928f87e None None] Releasing lock "compute-rpcapi-router" {{(pid=61933) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 17:03:48 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-4c862a1c-1a69-44ed-90e2-b5484928f87e None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.188045 Apr 14 17:03:48 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 22/66] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:03:48 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:03:48 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0488788-7b88-4c48-9fcd-02640c09feb1", "name": "network-vif-plugged", "status": "completed", "tag": "adb6bafa-17f9-4c4e-af68-632cc59c3a03"}, {"server_uuid": "6e707b44-e838-4494-9fbc-5698e755e09e", "name": "network-vif-plugged", "status": "completed", "tag": "5572c41c-64e8-4058-9a5e-f3a994e78787"}, {"server_uuid": "6e707b44-e838-4494-9fbc-5698e755e09e", "name": "network-vif-plugged", "status": "completed", "tag": "5572c41c-64e8-4058-9a5e-f3a994e78787"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:48 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:48 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] Creating event network-vif-plugged:adb6bafa-17f9-4c4e-af68-632cc59c3a03 for instance c0488788-7b88-4c48-9fcd-02640c09feb1 on user Apr 14 17:03:48 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] Creating event network-vif-plugged:5572c41c-64e8-4058-9a5e-f3a994e78787 for instance 6e707b44-e838-4494-9fbc-5698e755e09e on user Apr 14 17:03:48 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] Creating event network-vif-plugged:5572c41c-64e8-4058-9a5e-f3a994e78787 for instance 6e707b44-e838-4494-9fbc-5698e755e09e on user Apr 14 17:03:48 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-a36f2845-b4da-4566-afcf-ccca708e288a req-4e282ca9-3ae9-4204-ba0f-b73235e6e726 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.111491 Apr 14 17:03:48 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 22/67] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:03:48 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:03:48 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:48 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-883128230", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "networks": [{"uuid": "6b1137c2-ea7b-406d-86c9-407c314c8247"}], "security_groups": [{"name": "tempest-securitygroup--984414502"}], "key_name": "tempest-keypair-1620409315", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:49 user devstack@n-api.service[61935]: DEBUG nova.network.neutron [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] validate_networks() for [('6b1137c2-ea7b-406d-86c9-407c314c8247', None, None, None, None, None)] {{(pid=61935) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:03:50 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d3cd5e92-2ecc-48aa-9118-29d98a5ef9e9 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Action: 'create', calling method: .version_select at 0x7fe19d43c160>, body: {"keypair": {"name": "tempest-keypair-1254425015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKt3AY0twBFJ/11W/wY1p+QHYZ5ZYF1ev1xFPxqsjQhohjW4GbK0pSGxU9yjNPkGClqmdyRmx+s0HpdzC0OQNkLSSuKwBe8eYLrWtvXtdg9FZxi6K1gvFXpYZYaXxHyN4g=="}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:50 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-d3cd5e92-2ecc-48aa-9118-29d98a5ef9e9 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Getting quotas for project 6431ad1110e748baaab4a94037e60782. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:03:50 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-d3cd5e92-2ecc-48aa-9118-29d98a5ef9e9 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Getting quotas for user d53afcd6995e4e7dbced957359802022 and project 6431ad1110e748baaab4a94037e60782. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:03:50 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d3cd5e92-2ecc-48aa-9118-29d98a5ef9e9 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.608386 Apr 14 17:03:50 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 23/68] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 17:03:49 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:03:50 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "name": "network-vif-plugged", "status": "completed", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}, {"server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "name": "network-vif-plugged", "status": "completed", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:50 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=7 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:50 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=15 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:50 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] Creating event network-vif-plugged:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:03:50 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] Creating event network-vif-plugged:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:03:50 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-b57cda50-ab55-4151-a115-b14868392f1e req-b9c23da0-8509-41a6-aeb6-4719c17a04ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.113096 Apr 14 17:03:50 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 23/69] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:03:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:03:51 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:52 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Flavor limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:03:52 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Image limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:03:52 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Flavor pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:03:52 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Image pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:03:52 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:03:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:52 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Getting quotas for project 5c8f41946e544d0c93cbceb3d03e50a5. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:03:52 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Getting quotas for user 01d0e8ec192748edbe2576ef1c1e1cb5 and project 5c8f41946e544d0c93cbceb3d03e50a5. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:03:52 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Going to run 1 instances... {{(pid=61935) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:03:52 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:03:52 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-0c6690b3-1e21-4c1a-b52f-0ce4e207ab17 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 3.705089 Apr 14 17:03:52 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 24/70] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:03:48 2023] POST /compute/v2.1/servers => generated 403 bytes in 3707 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:03:52 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-408e089f-5134-4ccb-9a63-dcbde8559d66 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:03:52 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-408e089f-5134-4ccb-9a63-dcbde8559d66 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:03:52 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-5f51038a-782d-443f-8930-87f6fe1cd0a2 req-9364ff8c-c13a-4e0c-989e-3e5f92c1f231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5920661-9030-4cf7-88a0-1ad789eec1bd", "name": "network-vif-plugged", "status": "completed", "tag": "526282d7-c5ce-4ae0-9745-4e43477222f0"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5f51038a-782d-443f-8930-87f6fe1cd0a2 req-9364ff8c-c13a-4e0c-989e-3e5f92c1f231 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5f51038a-782d-443f-8930-87f6fe1cd0a2 req-9364ff8c-c13a-4e0c-989e-3e5f92c1f231 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5f51038a-782d-443f-8930-87f6fe1cd0a2 req-9364ff8c-c13a-4e0c-989e-3e5f92c1f231 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:52 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-5f51038a-782d-443f-8930-87f6fe1cd0a2 req-9364ff8c-c13a-4e0c-989e-3e5f92c1f231 service nova] Creating event network-vif-plugged:526282d7-c5ce-4ae0-9745-4e43477222f0 for instance d5920661-9030-4cf7-88a0-1ad789eec1bd on user Apr 14 17:03:52 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-5f51038a-782d-443f-8930-87f6fe1cd0a2 req-9364ff8c-c13a-4e0c-989e-3e5f92c1f231 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063234 Apr 14 17:03:52 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 24/71] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:03:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:03:52 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-408e089f-5134-4ccb-9a63-dcbde8559d66 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d0e8ec192748edbe2576ef1c1e1cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8f41946e544d0c93cbceb3d03e50a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:03:52 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-408e089f-5134-4ccb-9a63-dcbde8559d66 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4" status: 200 len: 1235 microversion: 2.1 time: 0.143084 Apr 14 17:03:52 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 24/72] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:03:52 2023] GET /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4 => generated 1235 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:03:54 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-91db4075-1a96-4f98-ad61-feca18509d0e req-b7af6201-8cfe-4752-9fdb-9b725a05544b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5920661-9030-4cf7-88a0-1ad789eec1bd", "name": "network-vif-plugged", "status": "completed", "tag": "526282d7-c5ce-4ae0-9745-4e43477222f0"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:54 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=7 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:54 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1187816968", "imageRef": "21bc9fa2-e92b-4bfd-92c3-eaa79b628388", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c"}], "security_groups": [{"name": "tempest-securitygroup--870615066"}], "key_name": "tempest-keypair-1254425015", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-91db4075-1a96-4f98-ad61-feca18509d0e req-b7af6201-8cfe-4752-9fdb-9b725a05544b service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-91db4075-1a96-4f98-ad61-feca18509d0e req-b7af6201-8cfe-4752-9fdb-9b725a05544b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-91db4075-1a96-4f98-ad61-feca18509d0e req-b7af6201-8cfe-4752-9fdb-9b725a05544b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:54 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=13 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:54 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-91db4075-1a96-4f98-ad61-feca18509d0e req-b7af6201-8cfe-4752-9fdb-9b725a05544b service nova] Creating event network-vif-plugged:526282d7-c5ce-4ae0-9745-4e43477222f0 for instance d5920661-9030-4cf7-88a0-1ad789eec1bd on user Apr 14 17:03:54 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-91db4075-1a96-4f98-ad61-feca18509d0e req-b7af6201-8cfe-4752-9fdb-9b725a05544b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067574 Apr 14 17:03:54 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 25/73] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:03:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 17:03:54 user devstack@n-api.service[61934]: DEBUG nova.network.neutron [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] validate_networks() for [('4c7108d9-e931-43bb-8ab2-9b3d5eb8b31c', None, None, None, None, None)] {{(pid=61934) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:03:54 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b741ea1d-1754-4aeb-9e38-d94f0c57132d tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Action: 'create', calling method: .version_select at 0x7fe19d43d000>, body: {"keypair": {"name": "tempest-keypair-1178292474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFc6ZfHKt1uU+YGTbQLPmXILQNP6tSFg76jl8Mc8eG/MpxCs2x8HxBR+c4ZFft6r9N7HjR6vD866q3goCTmG74sv9Hr3kvUkBHdg1JMK5TKDs2H70tdLAEuBaOJNax57+w=="}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:54 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-b741ea1d-1754-4aeb-9e38-d94f0c57132d tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Getting quotas for project e21607283fae4bd0a679948ea8fa4881. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:03:54 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-b741ea1d-1754-4aeb-9e38-d94f0c57132d tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Getting quotas for user d79ebfd1410c4ffda69bc3bfaebbc25d and project e21607283fae4bd0a679948ea8fa4881. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:03:55 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-b741ea1d-1754-4aeb-9e38-d94f0c57132d tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070327 Apr 14 17:03:55 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 25/74] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 17:03:54 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:03:57 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1182786727", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "networks": [{"uuid": "895fe8ee-807e-44d1-a05e-3b9f2ff7af8c"}], "security_groups": [{"name": "tempest-securitygroup--1023048964"}], "key_name": "tempest-keypair-1178292474", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:57 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:03:57 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:03:57 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:03:57 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:03:57 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:03:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:57 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Getting quotas for project 6431ad1110e748baaab4a94037e60782. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:03:57 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Getting quotas for user d53afcd6995e4e7dbced957359802022 and project 6431ad1110e748baaab4a94037e60782. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:03:57 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Going to run 1 instances... {{(pid=61934) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:03:57 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='21bc9fa2-e92b-4bfd-92c3-eaa79b628388',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:03:57 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-d03584f4-9690-43ac-a7be-3dea9f8785cc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.727443 Apr 14 17:03:57 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 25/75] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:03:54 2023] POST /compute/v2.1/servers => generated 403 bytes in 2731 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:03:57 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-19459e96-b1eb-46f0-8c06-9d3c95fe54b3 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:03:57 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-19459e96-b1eb-46f0-8c06-9d3c95fe54b3 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:03:57 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:57 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-19459e96-b1eb-46f0-8c06-9d3c95fe54b3 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53afcd6995e4e7dbced957359802022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6431ad1110e748baaab4a94037e60782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:03:57 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=35 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:57 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-19459e96-b1eb-46f0-8c06-9d3c95fe54b3 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9" status: 200 len: 1240 microversion: 2.1 time: 0.162799 Apr 14 17:03:57 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 26/76] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:03:57 2023] GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9 => generated 1240 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:03:57 user devstack@n-api.service[61935]: DEBUG nova.network.neutron [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] validate_networks() for [('895fe8ee-807e-44d1-a05e-3b9f2ff7af8c', None, None, None, None, None)] {{(pid=61935) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:03:58 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Flavor limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:03:58 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Image limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:03:58 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Flavor pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:03:58 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Image pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:03:58 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:03:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:03:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:03:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:03:58 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Getting quotas for project e21607283fae4bd0a679948ea8fa4881. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:03:58 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Getting quotas for user d79ebfd1410c4ffda69bc3bfaebbc25d and project e21607283fae4bd0a679948ea8fa4881. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:03:58 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Going to run 1 instances... {{(pid=61935) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:03:58 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:03:59 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-abc60416-b5a1-457f-9efe-27e76d2568ed tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Action: 'create', calling method: .version_select at 0x7fe19d445360>, body: {"keypair": {"name": "tempest-keypair-692507657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECg8d5n9LW7VmLUC8d5gPYXfqjvX+xeRDOJKP2pamOBok1Te9o6aABTmc8Ly+rXwzA+gkXToWtNJacwSVXMwVNNM41xNc5dXCT1OuwHirxWzs5OwqJVInN23ojeeXTjiQ=="}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:03:59 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-57019845-8114-4224-995b-2e467b54a628 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.036667 Apr 14 17:03:59 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 26/77] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:03:57 2023] POST /compute/v2.1/servers => generated 404 bytes in 2039 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:03:59 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-abc60416-b5a1-457f-9efe-27e76d2568ed tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Getting quotas for project 924256f7ef8c4a5a832a87d1c198c50a. Resources: {'key_pairs'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:03:59 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-ab585d2a-ea78-4d0d-83c0-826b8c020cfe tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:03:59 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-ab585d2a-ea78-4d0d-83c0-826b8c020cfe tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:03:59 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:59 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:03:59 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-abc60416-b5a1-457f-9efe-27e76d2568ed tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Getting quotas for user c31588acbcc345519934f4c3a395b0c5 and project 924256f7ef8c4a5a832a87d1c198c50a. Resources: {'key_pairs'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:03:59 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-abc60416-b5a1-457f-9efe-27e76d2568ed tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.49 time: 0.121383 Apr 14 17:03:59 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 26/78] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 17:03:59 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 17:03:59 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-ab585d2a-ea78-4d0d-83c0-826b8c020cfe tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79ebfd1410c4ffda69bc3bfaebbc25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21607283fae4bd0a679948ea8fa4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:03:59 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-ab585d2a-ea78-4d0d-83c0-826b8c020cfe tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1" status: 200 len: 1226 microversion: 2.1 time: 0.103531 Apr 14 17:03:59 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 27/79] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:03:59 2023] GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:04:00 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-b9751974-fe80-4a35-9bdf-250feeb31136 req-4b9c57c3-7c83-4664-a641-42e908983d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add03bde-bc0e-436a-a994-e81c3f75e4c4", "tag": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-b9751974-fe80-4a35-9bdf-250feeb31136 req-4b9c57c3-7c83-4664-a641-42e908983d5d service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-b9751974-fe80-4a35-9bdf-250feeb31136 req-4b9c57c3-7c83-4664-a641-42e908983d5d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-b9751974-fe80-4a35-9bdf-250feeb31136 req-4b9c57c3-7c83-4664-a641-42e908983d5d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:00 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-b9751974-fe80-4a35-9bdf-250feeb31136 req-4b9c57c3-7c83-4664-a641-42e908983d5d service nova] Creating event network-changed:0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance add03bde-bc0e-436a-a994-e81c3f75e4c4 on user Apr 14 17:04:00 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-b9751974-fe80-4a35-9bdf-250feeb31136 req-4b9c57c3-7c83-4664-a641-42e908983d5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122831 Apr 14 17:04:00 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 27/80] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:04:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:04:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-82d9bf44-b4af-40d8-88ae-27e29c7ed92d req-993b2c1e-6822-48cf-bf54-daba563bfa2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80bd1dd9-b80e-4533-98d5-0ca798bc4be9", "tag": "3c8c7d04-4fcc-498a-b858-122cea028627"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:01 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-82d9bf44-b4af-40d8-88ae-27e29c7ed92d req-993b2c1e-6822-48cf-bf54-daba563bfa2e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:01 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-82d9bf44-b4af-40d8-88ae-27e29c7ed92d req-993b2c1e-6822-48cf-bf54-daba563bfa2e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:01 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-82d9bf44-b4af-40d8-88ae-27e29c7ed92d req-993b2c1e-6822-48cf-bf54-daba563bfa2e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:01 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-82d9bf44-b4af-40d8-88ae-27e29c7ed92d req-993b2c1e-6822-48cf-bf54-daba563bfa2e service nova] Creating event network-changed:3c8c7d04-4fcc-498a-b858-122cea028627 for instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 on user Apr 14 17:04:01 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-82d9bf44-b4af-40d8-88ae-27e29c7ed92d req-993b2c1e-6822-48cf-bf54-daba563bfa2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036145 Apr 14 17:04:01 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 27/81] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:04:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:04:02 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1042660194", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "d5e124d4-8ab6-4d66-b15c-92acd7a77bdf"}], "security_groups": [{"name": "tempest-securitygroup--1086166239"}], "key_name": "tempest-keypair-692507657", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:02 user devstack@n-api.service[61933]: DEBUG nova.network.neutron [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] validate_networks() for [('d5e124d4-8ab6-4d66-b15c-92acd7a77bdf', None, None, None, None, None)] {{(pid=61933) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:04:03 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-48a6e746-4453-48a4-ad1f-fbd2cfe851cb req-96fb96ea-1194-49a4-898b-f1160496955a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f53cfe1f-c915-4a74-8512-84a97147f1d1", "tag": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-48a6e746-4453-48a4-ad1f-fbd2cfe851cb req-96fb96ea-1194-49a4-898b-f1160496955a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-48a6e746-4453-48a4-ad1f-fbd2cfe851cb req-96fb96ea-1194-49a4-898b-f1160496955a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-48a6e746-4453-48a4-ad1f-fbd2cfe851cb req-96fb96ea-1194-49a4-898b-f1160496955a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:03 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-48a6e746-4453-48a4-ad1f-fbd2cfe851cb req-96fb96ea-1194-49a4-898b-f1160496955a service nova] Creating event network-changed:dfe61768-29ed-4753-b77a-dcc14e1ce6c2 for instance f53cfe1f-c915-4a74-8512-84a97147f1d1 on user Apr 14 17:04:03 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-48a6e746-4453-48a4-ad1f-fbd2cfe851cb req-96fb96ea-1194-49a4-898b-f1160496955a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072716 Apr 14 17:04:03 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 28/82] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:04:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:04:03 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-882fd478-18c1-41fc-be0e-f9247c16bea1 req-7c6857d6-79ed-4662-b412-fdf37d57bc51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add03bde-bc0e-436a-a994-e81c3f75e4c4", "name": "network-vif-plugged", "status": "completed", "tag": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:03 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-882fd478-18c1-41fc-be0e-f9247c16bea1 req-7c6857d6-79ed-4662-b412-fdf37d57bc51 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:03 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-882fd478-18c1-41fc-be0e-f9247c16bea1 req-7c6857d6-79ed-4662-b412-fdf37d57bc51 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:03 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-882fd478-18c1-41fc-be0e-f9247c16bea1 req-7c6857d6-79ed-4662-b412-fdf37d57bc51 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:04 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-882fd478-18c1-41fc-be0e-f9247c16bea1 req-7c6857d6-79ed-4662-b412-fdf37d57bc51 service nova] Creating event network-vif-plugged:0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance add03bde-bc0e-436a-a994-e81c3f75e4c4 on user Apr 14 17:04:04 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-882fd478-18c1-41fc-be0e-f9247c16bea1 req-7c6857d6-79ed-4662-b412-fdf37d57bc51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066324 Apr 14 17:04:04 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 28/83] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:04:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:04:04 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Flavor limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:04:04 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Image limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:04:04 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Flavor pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:04:04 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Image pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:04:04 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:04:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:04 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Getting quotas for project 924256f7ef8c4a5a832a87d1c198c50a. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:04:04 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Getting quotas for user c31588acbcc345519934f4c3a395b0c5 and project 924256f7ef8c4a5a832a87d1c198c50a. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:04:04 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Going to run 1 instances... {{(pid=61933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:04:04 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:04:04 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-594da8e0-3146-4537-9404-dd7869ef1d67 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 1.458044 Apr 14 17:04:04 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 28/84] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 17:04:02 2023] POST /compute/v2.1/servers => generated 404 bytes in 1461 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 14 17:04:04 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-c2dfa908-34e9-442d-8bcd-0b1d1c0bfcc0 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:04:04 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-c2dfa908-34e9-442d-8bcd-0b1d1c0bfcc0 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:04:04 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-c2dfa908-34e9-442d-8bcd-0b1d1c0bfcc0 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31588acbcc345519934f4c3a395b0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924256f7ef8c4a5a832a87d1c198c50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:04:04 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-c2dfa908-34e9-442d-8bcd-0b1d1c0bfcc0 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c31588acbcc345519934f4c3a395b0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924256f7ef8c4a5a832a87d1c198c50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:04:04 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-c2dfa908-34e9-442d-8bcd-0b1d1c0bfcc0 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c31588acbcc345519934f4c3a395b0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924256f7ef8c4a5a832a87d1c198c50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:04:04 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-c2dfa908-34e9-442d-8bcd-0b1d1c0bfcc0 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] 10.0.0.210 "GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173" status: 200 len: 1320 microversion: 2.49 time: 0.120978 Apr 14 17:04:04 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 29/85] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:04:04 2023] GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173 => generated 1320 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:04:06 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-85f0f2f0-8c87-451c-bdd4-2498197147c1 req-793e2339-a0d8-4830-82bc-b3e89d8e6e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add03bde-bc0e-436a-a994-e81c3f75e4c4", "name": "network-vif-plugged", "status": "completed", "tag": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:06 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-85f0f2f0-8c87-451c-bdd4-2498197147c1 req-793e2339-a0d8-4830-82bc-b3e89d8e6e6f service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:06 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-85f0f2f0-8c87-451c-bdd4-2498197147c1 req-793e2339-a0d8-4830-82bc-b3e89d8e6e6f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:06 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-85f0f2f0-8c87-451c-bdd4-2498197147c1 req-793e2339-a0d8-4830-82bc-b3e89d8e6e6f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:06 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-85f0f2f0-8c87-451c-bdd4-2498197147c1 req-793e2339-a0d8-4830-82bc-b3e89d8e6e6f service nova] Creating event network-vif-plugged:0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance add03bde-bc0e-436a-a994-e81c3f75e4c4 on user Apr 14 17:04:06 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-85f0f2f0-8c87-451c-bdd4-2498197147c1 req-793e2339-a0d8-4830-82bc-b3e89d8e6e6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052522 Apr 14 17:04:06 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 29/86] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:04:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:04:07 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-3d8fab84-50b0-490f-a167-fe9263caccfd req-db389b57-5cad-44da-add3-f12eb441ccee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53cfe1f-c915-4a74-8512-84a97147f1d1", "name": "network-vif-plugged", "status": "completed", "tag": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-3d8fab84-50b0-490f-a167-fe9263caccfd req-db389b57-5cad-44da-add3-f12eb441ccee service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-3d8fab84-50b0-490f-a167-fe9263caccfd req-db389b57-5cad-44da-add3-f12eb441ccee service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-3d8fab84-50b0-490f-a167-fe9263caccfd req-db389b57-5cad-44da-add3-f12eb441ccee service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:07 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-3d8fab84-50b0-490f-a167-fe9263caccfd req-db389b57-5cad-44da-add3-f12eb441ccee service nova] Creating event network-vif-plugged:dfe61768-29ed-4753-b77a-dcc14e1ce6c2 for instance f53cfe1f-c915-4a74-8512-84a97147f1d1 on user Apr 14 17:04:07 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-3d8fab84-50b0-490f-a167-fe9263caccfd req-db389b57-5cad-44da-add3-f12eb441ccee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068977 Apr 14 17:04:07 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 29/87] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:04:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:04:07 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-d446ca8f-e735-4723-bb8d-47ff2a03d2eb req-4e2408e4-3040-491d-95ae-a93f90b5ff80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "113dda5c-a61e-423b-86ea-2fe30a113173", "tag": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-d446ca8f-e735-4723-bb8d-47ff2a03d2eb req-4e2408e4-3040-491d-95ae-a93f90b5ff80 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-d446ca8f-e735-4723-bb8d-47ff2a03d2eb req-4e2408e4-3040-491d-95ae-a93f90b5ff80 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-d446ca8f-e735-4723-bb8d-47ff2a03d2eb req-4e2408e4-3040-491d-95ae-a93f90b5ff80 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:07 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-d446ca8f-e735-4723-bb8d-47ff2a03d2eb req-4e2408e4-3040-491d-95ae-a93f90b5ff80 service nova] Creating event network-changed:34ea1bd9-f010-4073-bf8d-351b0e85ceeb for instance 113dda5c-a61e-423b-86ea-2fe30a113173 on user Apr 14 17:04:07 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-d446ca8f-e735-4723-bb8d-47ff2a03d2eb req-4e2408e4-3040-491d-95ae-a93f90b5ff80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046657 Apr 14 17:04:07 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 30/88] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:04:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:04:08 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:08 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bd1dd9-b80e-4533-98d5-0ca798bc4be9", "name": "network-vif-plugged", "status": "completed", "tag": "3c8c7d04-4fcc-498a-b858-122cea028627"}, {"server_uuid": "80bd1dd9-b80e-4533-98d5-0ca798bc4be9", "name": "network-vif-plugged", "status": "completed", "tag": "3c8c7d04-4fcc-498a-b858-122cea028627"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:08 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:08 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:08 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:08 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] Creating event network-vif-plugged:3c8c7d04-4fcc-498a-b858-122cea028627 for instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 on user Apr 14 17:04:08 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] Creating event network-vif-plugged:3c8c7d04-4fcc-498a-b858-122cea028627 for instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 on user Apr 14 17:04:08 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-3eb253e9-fb4f-4ea3-99d1-2cd1e3763aef req-842d49f3-0c88-450b-b254-4cb590fb5ad1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.079230 Apr 14 17:04:08 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 30/89] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:04:08 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:04:09 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-58f5d670-0e9c-47f0-b383-bf249b44de05 req-d053dc9b-fb76-4ac2-88bd-e95ad9221cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53cfe1f-c915-4a74-8512-84a97147f1d1", "name": "network-vif-plugged", "status": "completed", "tag": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:09 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-58f5d670-0e9c-47f0-b383-bf249b44de05 req-d053dc9b-fb76-4ac2-88bd-e95ad9221cf3 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:09 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-58f5d670-0e9c-47f0-b383-bf249b44de05 req-d053dc9b-fb76-4ac2-88bd-e95ad9221cf3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:09 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-58f5d670-0e9c-47f0-b383-bf249b44de05 req-d053dc9b-fb76-4ac2-88bd-e95ad9221cf3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:09 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-58f5d670-0e9c-47f0-b383-bf249b44de05 req-d053dc9b-fb76-4ac2-88bd-e95ad9221cf3 service nova] Creating event network-vif-plugged:dfe61768-29ed-4753-b77a-dcc14e1ce6c2 for instance f53cfe1f-c915-4a74-8512-84a97147f1d1 on user Apr 14 17:04:09 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-58f5d670-0e9c-47f0-b383-bf249b44de05 req-d053dc9b-fb76-4ac2-88bd-e95ad9221cf3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052974 Apr 14 17:04:09 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 30/90] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:04:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:04:10 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:10 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-23da5933-af74-40d6-8811-95e1b564835b req-7d90ca64-02d3-4cea-b1b4-90533c55a1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113dda5c-a61e-423b-86ea-2fe30a113173", "name": "network-vif-plugged", "status": "completed", "tag": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-23da5933-af74-40d6-8811-95e1b564835b req-7d90ca64-02d3-4cea-b1b4-90533c55a1f1 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-23da5933-af74-40d6-8811-95e1b564835b req-7d90ca64-02d3-4cea-b1b4-90533c55a1f1 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-23da5933-af74-40d6-8811-95e1b564835b req-7d90ca64-02d3-4cea-b1b4-90533c55a1f1 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:10 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-23da5933-af74-40d6-8811-95e1b564835b req-7d90ca64-02d3-4cea-b1b4-90533c55a1f1 service nova] Creating event network-vif-plugged:34ea1bd9-f010-4073-bf8d-351b0e85ceeb for instance 113dda5c-a61e-423b-86ea-2fe30a113173 on user Apr 14 17:04:10 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-23da5933-af74-40d6-8811-95e1b564835b req-7d90ca64-02d3-4cea-b1b4-90533c55a1f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095300 Apr 14 17:04:10 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 31/91] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:04:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:04:13 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-55105700-da91-4d59-81c7-febb7f22a273 req-e2b13ed9-0a0b-419d-bbcc-efc036f9472f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113dda5c-a61e-423b-86ea-2fe30a113173", "name": "network-vif-plugged", "status": "completed", "tag": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:13 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=10 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-55105700-da91-4d59-81c7-febb7f22a273 req-e2b13ed9-0a0b-419d-bbcc-efc036f9472f service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-55105700-da91-4d59-81c7-febb7f22a273 req-e2b13ed9-0a0b-419d-bbcc-efc036f9472f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-55105700-da91-4d59-81c7-febb7f22a273 req-e2b13ed9-0a0b-419d-bbcc-efc036f9472f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:13 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-55105700-da91-4d59-81c7-febb7f22a273 req-e2b13ed9-0a0b-419d-bbcc-efc036f9472f service nova] Creating event network-vif-plugged:34ea1bd9-f010-4073-bf8d-351b0e85ceeb for instance 113dda5c-a61e-423b-86ea-2fe30a113173 on user Apr 14 17:04:13 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-55105700-da91-4d59-81c7-febb7f22a273 req-e2b13ed9-0a0b-419d-bbcc-efc036f9472f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161605 Apr 14 17:04:13 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 31/92] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:04:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:04:19 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d3ce4c0c-438c-4a73-a72f-bb9229ce1892 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:04:19 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-d3ce4c0c-438c-4a73-a72f-bb9229ce1892 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:04:19 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:19 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=9 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d3ce4c0c-438c-4a73-a72f-bb9229ce1892 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d3ce4c0c-438c-4a73-a72f-bb9229ce1892 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d3ce4c0c-438c-4a73-a72f-bb9229ce1892 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d3ce4c0c-438c-4a73-a72f-bb9229ce1892 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d3ce4c0c-438c-4a73-a72f-bb9229ce1892 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d3ce4c0c-438c-4a73-a72f-bb9229ce1892 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:19 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-d3ce4c0c-438c-4a73-a72f-bb9229ce1892 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1ea0218b044c1e94f61a07c1d14a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426156fb00db428683851cf731b680d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:04:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d3ce4c0c-438c-4a73-a72f-bb9229ce1892 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d" status: 200 len: 1492 microversion: 2.1 time: 0.403033 Apr 14 17:04:19 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 31/93] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:04:19 2023] GET /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d => generated 1492 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:04:20 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=14 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:20 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-d6470037-a4d2-4015-8629-c21b16d9985e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:04:20 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-d6470037-a4d2-4015-8629-c21b16d9985e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:04:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d6470037-a4d2-4015-8629-c21b16d9985e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d6470037-a4d2-4015-8629-c21b16d9985e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d6470037-a4d2-4015-8629-c21b16d9985e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d6470037-a4d2-4015-8629-c21b16d9985e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d6470037-a4d2-4015-8629-c21b16d9985e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d6470037-a4d2-4015-8629-c21b16d9985e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:20 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-b8328b1d-f59f-4b0a-ac85-ab8bc883b7be tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:04:20 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-b8328b1d-f59f-4b0a-ac85-ab8bc883b7be tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:04:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b8328b1d-f59f-4b0a-ac85-ab8bc883b7be tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b8328b1d-f59f-4b0a-ac85-ab8bc883b7be tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b8328b1d-f59f-4b0a-ac85-ab8bc883b7be tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b8328b1d-f59f-4b0a-ac85-ab8bc883b7be tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b8328b1d-f59f-4b0a-ac85-ab8bc883b7be tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b8328b1d-f59f-4b0a-ac85-ab8bc883b7be tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:21 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-d6470037-a4d2-4015-8629-c21b16d9985e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c9e0d318eb4ca49d47d620682fb00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f341a2096b9483787b569a59f325556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:04:21 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-d6470037-a4d2-4015-8629-c21b16d9985e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1" status: 200 len: 1544 microversion: 2.1 time: 1.055542 Apr 14 17:04:21 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 32/94] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:04:20 2023] GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1 => generated 1544 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:04:21 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-b8328b1d-f59f-4b0a-ac85-ab8bc883b7be tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c4734925f645248b0f9060aa78a502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8f6b39515e456c9f5a1affa9f79000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:04:21 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-b8328b1d-f59f-4b0a-ac85-ab8bc883b7be tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97" status: 200 len: 1535 microversion: 2.1 time: 0.840836 Apr 14 17:04:21 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 32/95] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:04:20 2023] GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97 => generated 1535 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:04:21 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d24fb90b-b745-47a2-843f-c0d04a1aa41f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:04:21 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-d24fb90b-b745-47a2-843f-c0d04a1aa41f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:04:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d24fb90b-b745-47a2-843f-c0d04a1aa41f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d24fb90b-b745-47a2-843f-c0d04a1aa41f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d24fb90b-b745-47a2-843f-c0d04a1aa41f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d24fb90b-b745-47a2-843f-c0d04a1aa41f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d24fb90b-b745-47a2-843f-c0d04a1aa41f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d24fb90b-b745-47a2-843f-c0d04a1aa41f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:22 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-d24fb90b-b745-47a2-843f-c0d04a1aa41f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d636ab92c4700b480ea58ce6a30ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762a37326f89466c9ee3714ea2e2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:04:22 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d24fb90b-b745-47a2-843f-c0d04a1aa41f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e" status: 200 len: 1490 microversion: 2.1 time: 0.651648 Apr 14 17:04:22 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 32/96] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:04:21 2023] GET /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e => generated 1490 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:04:26 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-7af59e4c-6ad8-44a4-8415-acf071021f68 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Action: 'create', calling method: .version_select at 0x7fe19d44f010>, body: {"keypair": {"name": "tempest-keypair-547297741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWA9KQNmyVtVBahU1IvUuM7sVxgFFhzDwHT5rAuu23q2Npz/sxfSt6/kUGwMQGHIdIFJ0CUW63Lzcwdy1hgUWSVLcX100QRva8W9jpSey8dBIDrdliGT+6fnKR/ZeDvBw=="}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:26 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:26 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-7af59e4c-6ad8-44a4-8415-acf071021f68 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Getting quotas for project 0706fb42134445cf914a9a00b1042c01. Resources: {'key_pairs'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:04:26 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-7af59e4c-6ad8-44a4-8415-acf071021f68 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Getting quotas for user 029c39b7ada54f7b9cb106f054ec8a0c and project 0706fb42134445cf914a9a00b1042c01. Resources: {'key_pairs'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:04:26 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-7af59e4c-6ad8-44a4-8415-acf071021f68 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.079328 Apr 14 17:04:26 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 33/97] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 17:04:26 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 17:04:27 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-12887603", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa"}, {"port": "d61ec716-2b00-4426-b014-fb1d07515463", "tag": "port-1"}, {"port": "f7320798-2ab9-411c-98dd-2f0006b0c3e2", "tag": "port-2"}, {"uuid": "71794092-e6e0-49a2-a984-cf885efb7f87", "tag": "net-1"}, {"uuid": "71794092-e6e0-49a2-a984-cf885efb7f87"}, {"uuid": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "9a91c7ee-7ec6-4e2c-9da7-857df3cf273e", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d8a2163e-cfca-4043-8f58-3bd6fb74c8f2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ff4fadca-3048-4c38-9134-4fc24981f87c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f0558a5b-2574-42f0-9f57-af61d85365f7", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1012279686"}], "key_name": "tempest-keypair-547297741", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:28 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:28 user devstack@n-api.service[61934]: DEBUG nova.network.neutron [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] validate_networks() for [('64f8b129-b2fa-40f5-8ac6-cf1f37fff6aa', None, None, None, None, None), (None, None, 'd61ec716-2b00-4426-b014-fb1d07515463', None, None, None), (None, None, 'f7320798-2ab9-411c-98dd-2f0006b0c3e2', None, None, None), ('71794092-e6e0-49a2-a984-cf885efb7f87', None, None, None, None, None), ('71794092-e6e0-49a2-a984-cf885efb7f87', None, None, None, None, None), ('9a91c7ee-7ec6-4e2c-9da7-857df3cf273e', '10.2.2.100', None, None, None, None), ('9a91c7ee-7ec6-4e2c-9da7-857df3cf273e', '10.2.2.200', None, None, None, None)] {{(pid=61934) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:04:30 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:04:30 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:04:30 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:04:30 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:04:30 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:04:30 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:30 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:30 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:30 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:30 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:30 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:30 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=22 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:30 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Getting quotas for project 0706fb42134445cf914a9a00b1042c01. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:04:30 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Getting quotas for user 029c39b7ada54f7b9cb106f054ec8a0c and project 0706fb42134445cf914a9a00b1042c01. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:04:30 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Going to run 1 instances... {{(pid=61934) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:04:30 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d8a2163e-cfca-4043-8f58-3bd6fb74c8f2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ff4fadca-3048-4c38-9134-4fc24981f87c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0558a5b-2574-42f0-9f57-af61d85365f7',volume_size=None,volume_type=None)] {{(pid=61934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:04:30 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-24eb2c95-a4e1-4660-971c-238f35d353db tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 2.973877 Apr 14 17:04:30 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 33/98] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 17:04:27 2023] POST /compute/v2.1/servers => generated 404 bytes in 2976 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 17:04:30 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-0e21814b-f347-4d55-9fa3-392e018eb51d tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:04:30 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-0e21814b-f347-4d55-9fa3-392e018eb51d tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:04:30 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:31 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-0e21814b-f347-4d55-9fa3-392e018eb51d tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029c39b7ada54f7b9cb106f054ec8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0706fb42134445cf914a9a00b1042c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:04:31 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-0e21814b-f347-4d55-9fa3-392e018eb51d tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '029c39b7ada54f7b9cb106f054ec8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0706fb42134445cf914a9a00b1042c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:04:31 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-0e21814b-f347-4d55-9fa3-392e018eb51d tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '029c39b7ada54f7b9cb106f054ec8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0706fb42134445cf914a9a00b1042c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:04:31 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-0e21814b-f347-4d55-9fa3-392e018eb51d tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58" status: 200 len: 1277 microversion: 2.32 time: 0.071878 Apr 14 17:04:31 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 33/99] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:04:30 2023] GET /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58 => generated 1277 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:04:31 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=17 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:31 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-e3521b7b-d291-4117-bfd6-b15c7f004374 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:04:31 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-e3521b7b-d291-4117-bfd6-b15c7f004374 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:04:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e3521b7b-d291-4117-bfd6-b15c7f004374 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e3521b7b-d291-4117-bfd6-b15c7f004374 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e3521b7b-d291-4117-bfd6-b15c7f004374 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e3521b7b-d291-4117-bfd6-b15c7f004374 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e3521b7b-d291-4117-bfd6-b15c7f004374 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e3521b7b-d291-4117-bfd6-b15c7f004374 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:31 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-e3521b7b-d291-4117-bfd6-b15c7f004374 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d67df67ba8e4905bf7c6545c5748a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2764eee6c4071b5607f78762ca653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:04:31 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-e3521b7b-d291-4117-bfd6-b15c7f004374 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd" status: 200 len: 1553 microversion: 2.1 time: 0.285723 Apr 14 17:04:31 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 34/100] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:04:31 2023] GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd => generated 1553 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:04:38 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-70f6347d-765b-4de6-89ac-a8a8854938d9 req-3379a30b-6915-4fe8-8f37-37dc247c1084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "tag": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-70f6347d-765b-4de6-89ac-a8a8854938d9 req-3379a30b-6915-4fe8-8f37-37dc247c1084 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-70f6347d-765b-4de6-89ac-a8a8854938d9 req-3379a30b-6915-4fe8-8f37-37dc247c1084 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-70f6347d-765b-4de6-89ac-a8a8854938d9 req-3379a30b-6915-4fe8-8f37-37dc247c1084 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:38 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-70f6347d-765b-4de6-89ac-a8a8854938d9 req-3379a30b-6915-4fe8-8f37-37dc247c1084 service nova] Creating event network-changed:908df516-5b0a-42b8-82d4-1f36c0dbcdc0 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:38 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-70f6347d-765b-4de6-89ac-a8a8854938d9 req-3379a30b-6915-4fe8-8f37-37dc247c1084 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065780 Apr 14 17:04:38 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 34/101] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:04:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:04:40 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "tag": "d61ec716-2b00-4426-b014-fb1d07515463"}, {"name": "network-changed", "server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "tag": "f7320798-2ab9-411c-98dd-2f0006b0c3e2"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:40 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=18 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:40 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:40 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:40 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:40 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] Creating event network-changed:d61ec716-2b00-4426-b014-fb1d07515463 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:40 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] Creating event network-changed:f7320798-2ab9-411c-98dd-2f0006b0c3e2 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:40 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-4bd4561b-bddf-40fc-949c-467807d75a36 req-b62ae4a7-3515-498e-8977-d668cc61bbe0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041271 Apr 14 17:04:40 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 34/102] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:04:40 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:04:42 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "tag": "3b216986-dcbd-4502-8655-92a598ad85db"}, {"name": "network-changed", "server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "tag": "c33eac6d-3cd4-491c-b151-abeb733a0a09"}, {"name": "network-changed", "server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "tag": "b14ce4b0-a632-4f21-b582-8aef000caf49"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:42 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:42 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:42 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:42 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:42 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:42 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:42 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] Creating event network-changed:3b216986-dcbd-4502-8655-92a598ad85db for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:42 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] Creating event network-changed:c33eac6d-3cd4-491c-b151-abeb733a0a09 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:42 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] Creating event network-changed:b14ce4b0-a632-4f21-b582-8aef000caf49 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:42 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-0e223f83-3702-4509-b2f4-96f7f9b37729 req-4bd7e8fb-3322-47df-aa9c-7c30b4015d65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.045925 Apr 14 17:04:42 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 35/103] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:04:42 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:04:42 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:42 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:42 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-9de58e29-56f9-4e69-b9fd-4f88e41ef830 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:04:42 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-9de58e29-56f9-4e69-b9fd-4f88e41ef830 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:04:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-9de58e29-56f9-4e69-b9fd-4f88e41ef830 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-9de58e29-56f9-4e69-b9fd-4f88e41ef830 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-9de58e29-56f9-4e69-b9fd-4f88e41ef830 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-9de58e29-56f9-4e69-b9fd-4f88e41ef830 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-9de58e29-56f9-4e69-b9fd-4f88e41ef830 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-9de58e29-56f9-4e69-b9fd-4f88e41ef830 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:42 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-9de58e29-56f9-4e69-b9fd-4f88e41ef830 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d0e8ec192748edbe2576ef1c1e1cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8f41946e544d0c93cbceb3d03e50a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:04:42 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-9de58e29-56f9-4e69-b9fd-4f88e41ef830 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4" status: 200 len: 1543 microversion: 2.1 time: 0.241409 Apr 14 17:04:42 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 35/104] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:04:42 2023] GET /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4 => generated 1543 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:04:44 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:44 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-1a6966dc-e5a9-46b8-9622-89d96e0a0a1c req-357969fa-423f-423c-a21f-0d80d81fdbbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "tag": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:44 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-1a6966dc-e5a9-46b8-9622-89d96e0a0a1c req-357969fa-423f-423c-a21f-0d80d81fdbbe service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:44 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-1a6966dc-e5a9-46b8-9622-89d96e0a0a1c req-357969fa-423f-423c-a21f-0d80d81fdbbe service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:44 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-1a6966dc-e5a9-46b8-9622-89d96e0a0a1c req-357969fa-423f-423c-a21f-0d80d81fdbbe service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:44 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-1a6966dc-e5a9-46b8-9622-89d96e0a0a1c req-357969fa-423f-423c-a21f-0d80d81fdbbe service nova] Creating event network-changed:da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:44 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-1a6966dc-e5a9-46b8-9622-89d96e0a0a1c req-357969fa-423f-423c-a21f-0d80d81fdbbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047006 Apr 14 17:04:44 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 35/105] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:04:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:04:47 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-e13143ee-2d01-480d-9170-216ed3a938c2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:04:47 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-e13143ee-2d01-480d-9170-216ed3a938c2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:04:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e13143ee-2d01-480d-9170-216ed3a938c2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e13143ee-2d01-480d-9170-216ed3a938c2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e13143ee-2d01-480d-9170-216ed3a938c2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e13143ee-2d01-480d-9170-216ed3a938c2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e13143ee-2d01-480d-9170-216ed3a938c2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e13143ee-2d01-480d-9170-216ed3a938c2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:47 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-e13143ee-2d01-480d-9170-216ed3a938c2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53afcd6995e4e7dbced957359802022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6431ad1110e748baaab4a94037e60782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:04:47 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-e13143ee-2d01-480d-9170-216ed3a938c2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9" status: 200 len: 1549 microversion: 2.1 time: 0.225119 Apr 14 17:04:47 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 36/106] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:04:47 2023] GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9 => generated 1549 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:04:49 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-59ff0aa3-fa65-4006-8926-a8f8e5113ae2 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:04:49 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-59ff0aa3-fa65-4006-8926-a8f8e5113ae2 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:04:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-59ff0aa3-fa65-4006-8926-a8f8e5113ae2 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-59ff0aa3-fa65-4006-8926-a8f8e5113ae2 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-59ff0aa3-fa65-4006-8926-a8f8e5113ae2 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-59ff0aa3-fa65-4006-8926-a8f8e5113ae2 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-59ff0aa3-fa65-4006-8926-a8f8e5113ae2 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-59ff0aa3-fa65-4006-8926-a8f8e5113ae2 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:49 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-59ff0aa3-fa65-4006-8926-a8f8e5113ae2 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79ebfd1410c4ffda69bc3bfaebbc25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21607283fae4bd0a679948ea8fa4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:04:49 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-59ff0aa3-fa65-4006-8926-a8f8e5113ae2 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1" status: 200 len: 1525 microversion: 2.1 time: 0.228498 Apr 14 17:04:49 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 36/107] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:04:49 2023] GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1 => generated 1525 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:04:54 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=7 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:54 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:04:54 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-869568b8-e5d3-4bbf-b513-653fb90282d7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:04:54 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-869568b8-e5d3-4bbf-b513-653fb90282d7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:04:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-869568b8-e5d3-4bbf-b513-653fb90282d7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-869568b8-e5d3-4bbf-b513-653fb90282d7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-869568b8-e5d3-4bbf-b513-653fb90282d7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-869568b8-e5d3-4bbf-b513-653fb90282d7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-869568b8-e5d3-4bbf-b513-653fb90282d7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-869568b8-e5d3-4bbf-b513-653fb90282d7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:54 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-869568b8-e5d3-4bbf-b513-653fb90282d7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31588acbcc345519934f4c3a395b0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924256f7ef8c4a5a832a87d1c198c50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:04:54 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-869568b8-e5d3-4bbf-b513-653fb90282d7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c31588acbcc345519934f4c3a395b0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924256f7ef8c4a5a832a87d1c198c50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:04:54 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-869568b8-e5d3-4bbf-b513-653fb90282d7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c31588acbcc345519934f4c3a395b0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924256f7ef8c4a5a832a87d1c198c50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:04:54 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-869568b8-e5d3-4bbf-b513-653fb90282d7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] 10.0.0.210 "GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173" status: 200 len: 1626 microversion: 2.49 time: 0.317212 Apr 14 17:04:54 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 36/108] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:04:54 2023] GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173 => generated 1626 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:04:56 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-d02f4436-10f4-44f1-ad7d-f0995fe5db38 req-751c2fe4-664b-4714-8d9f-9dc8df641eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-d02f4436-10f4-44f1-ad7d-f0995fe5db38 req-751c2fe4-664b-4714-8d9f-9dc8df641eed service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-d02f4436-10f4-44f1-ad7d-f0995fe5db38 req-751c2fe4-664b-4714-8d9f-9dc8df641eed service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-d02f4436-10f4-44f1-ad7d-f0995fe5db38 req-751c2fe4-664b-4714-8d9f-9dc8df641eed service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:56 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-d02f4436-10f4-44f1-ad7d-f0995fe5db38 req-751c2fe4-664b-4714-8d9f-9dc8df641eed service nova] Creating event network-vif-plugged:908df516-5b0a-42b8-82d4-1f36c0dbcdc0 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:56 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-d02f4436-10f4-44f1-ad7d-f0995fe5db38 req-751c2fe4-664b-4714-8d9f-9dc8df641eed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033675 Apr 14 17:04:56 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 37/109] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:04:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:04:57 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-273ff906-32fb-4cb4-929d-5ae4fefa30c3 req-1a92f257-0248-4ee2-862a-5e5dbacb6c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "f7320798-2ab9-411c-98dd-2f0006b0c3e2"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-273ff906-32fb-4cb4-929d-5ae4fefa30c3 req-1a92f257-0248-4ee2-862a-5e5dbacb6c66 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-273ff906-32fb-4cb4-929d-5ae4fefa30c3 req-1a92f257-0248-4ee2-862a-5e5dbacb6c66 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-273ff906-32fb-4cb4-929d-5ae4fefa30c3 req-1a92f257-0248-4ee2-862a-5e5dbacb6c66 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:57 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-273ff906-32fb-4cb4-929d-5ae4fefa30c3 req-1a92f257-0248-4ee2-862a-5e5dbacb6c66 service nova] Creating event network-vif-plugged:f7320798-2ab9-411c-98dd-2f0006b0c3e2 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:57 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-273ff906-32fb-4cb4-929d-5ae4fefa30c3 req-1a92f257-0248-4ee2-862a-5e5dbacb6c66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037185 Apr 14 17:04:57 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 37/110] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:04:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:04:58 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "d61ec716-2b00-4426-b014-fb1d07515463"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "d61ec716-2b00-4426-b014-fb1d07515463"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "3b216986-dcbd-4502-8655-92a598ad85db"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "3b216986-dcbd-4502-8655-92a598ad85db"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "c33eac6d-3cd4-491c-b151-abeb733a0a09"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "c33eac6d-3cd4-491c-b151-abeb733a0a09"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Creating event network-vif-plugged:908df516-5b0a-42b8-82d4-1f36c0dbcdc0 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Creating event network-vif-plugged:d61ec716-2b00-4426-b014-fb1d07515463 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Creating event network-vif-plugged:d61ec716-2b00-4426-b014-fb1d07515463 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Creating event network-vif-plugged:3b216986-dcbd-4502-8655-92a598ad85db for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Creating event network-vif-plugged:3b216986-dcbd-4502-8655-92a598ad85db for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Creating event network-vif-plugged:c33eac6d-3cd4-491c-b151-abeb733a0a09 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Creating event network-vif-plugged:c33eac6d-3cd4-491c-b151-abeb733a0a09 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] Creating event network-vif-plugged:da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-b01a3bd4-7731-4c61-9d52-361be99f3cf9 req-f6e3d86c-4e1d-41b8-9fd3-fe7187c189c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1380 microversion: 2.1 time: 0.301203 Apr 14 17:04:58 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 37/111] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 17:04:58 2023] POST /compute/v2.1/os-server-external-events => generated 1380 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:04:59 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "f7320798-2ab9-411c-98dd-2f0006b0c3e2"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "b14ce4b0-a632-4f21-b582-8aef000caf49"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "b14ce4b0-a632-4f21-b582-8aef000caf49"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:04:59 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:04:59 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:04:59 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:04:59 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] Creating event network-vif-plugged:f7320798-2ab9-411c-98dd-2f0006b0c3e2 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:59 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] Creating event network-vif-plugged:b14ce4b0-a632-4f21-b582-8aef000caf49 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:59 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] Creating event network-vif-plugged:b14ce4b0-a632-4f21-b582-8aef000caf49 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:04:59 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-abc3e7de-020d-4dcc-8d04-b56f25796fac req-f14b5664-adc4-43f9-a8b4-3d21f7b3b85e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.036984 Apr 14 17:04:59 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 38/112] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:04:59 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:00 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-5560da20-0054-435c-bd0f-d0c91ea6e531 req-0d7dac65-0467-4700-a115-89136908f1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:00 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:05:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5560da20-0054-435c-bd0f-d0c91ea6e531 req-0d7dac65-0467-4700-a115-89136908f1e1 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5560da20-0054-435c-bd0f-d0c91ea6e531 req-0d7dac65-0467-4700-a115-89136908f1e1 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5560da20-0054-435c-bd0f-d0c91ea6e531 req-0d7dac65-0467-4700-a115-89136908f1e1 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:00 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=18 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:05:00 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-5560da20-0054-435c-bd0f-d0c91ea6e531 req-0d7dac65-0467-4700-a115-89136908f1e1 service nova] Creating event network-vif-plugged:da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:05:00 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-5560da20-0054-435c-bd0f-d0c91ea6e531 req-0d7dac65-0467-4700-a115-89136908f1e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034202 Apr 14 17:05:00 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 38/113] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:19 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:05:19 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=8 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:05:19 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-373292303", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "networks": [{"uuid": "bba4f725-673c-4e1a-a5bb-a435afc40332"}]}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:19 user devstack@n-api.service[61933]: DEBUG nova.network.neutron [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] validate_networks() for [('bba4f725-673c-4e1a-a5bb-a435afc40332', None, None, None, None, None)] {{(pid=61933) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:05:20 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Flavor limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:05:20 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Image limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:05:20 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Flavor pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:05:20 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Image pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:05:20 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:05:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:20 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Getting quotas for project 426156fb00db428683851cf731b680d1. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:05:20 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Getting quotas for user 0d1ea0218b044c1e94f61a07c1d14a75 and project 426156fb00db428683851cf731b680d1. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:05:20 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Going to run 1 instances... {{(pid=61933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:05:20 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:05:20 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-e24039a6-5cf2-4d9d-8cda-16a2fd1abae5 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.670487 Apr 14 17:05:20 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 38/114] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:05:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:05:20 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-b7406e49-fcc6-4141-93c3-45459a5b23d7 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:20 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-b7406e49-fcc6-4141-93c3-45459a5b23d7 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:20 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=8 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:05:20 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=12 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:05:20 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-b7406e49-fcc6-4141-93c3-45459a5b23d7 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1ea0218b044c1e94f61a07c1d14a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426156fb00db428683851cf731b680d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:05:20 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-b7406e49-fcc6-4141-93c3-45459a5b23d7 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7465a41f-c916-4cca-8084-7c646409007d" status: 200 len: 1210 microversion: 2.1 time: 0.079144 Apr 14 17:05:20 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 39/115] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:05:20 2023] GET /compute/v2.1/servers/7465a41f-c916-4cca-8084-7c646409007d => generated 1210 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:05:21 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-2f23ffe7-6efa-4995-87d7-354ce0003d76 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:21 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-2f23ffe7-6efa-4995-87d7-354ce0003d76 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:21 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2f23ffe7-6efa-4995-87d7-354ce0003d76 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:21 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2f23ffe7-6efa-4995-87d7-354ce0003d76 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:21 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2f23ffe7-6efa-4995-87d7-354ce0003d76 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:21 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2f23ffe7-6efa-4995-87d7-354ce0003d76 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:21 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2f23ffe7-6efa-4995-87d7-354ce0003d76 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:21 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2f23ffe7-6efa-4995-87d7-354ce0003d76 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:21 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-930714cd-e56c-4852-aa6c-0ddfd90999b9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:21 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-930714cd-e56c-4852-aa6c-0ddfd90999b9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-930714cd-e56c-4852-aa6c-0ddfd90999b9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-930714cd-e56c-4852-aa6c-0ddfd90999b9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-930714cd-e56c-4852-aa6c-0ddfd90999b9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-930714cd-e56c-4852-aa6c-0ddfd90999b9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-930714cd-e56c-4852-aa6c-0ddfd90999b9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-930714cd-e56c-4852-aa6c-0ddfd90999b9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:21 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-f0e9250f-c6b6-412e-81e7-1c8ccb680441 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:21 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-f0e9250f-c6b6-412e-81e7-1c8ccb680441 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f0e9250f-c6b6-412e-81e7-1c8ccb680441 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f0e9250f-c6b6-412e-81e7-1c8ccb680441 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f0e9250f-c6b6-412e-81e7-1c8ccb680441 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f0e9250f-c6b6-412e-81e7-1c8ccb680441 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f0e9250f-c6b6-412e-81e7-1c8ccb680441 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f0e9250f-c6b6-412e-81e7-1c8ccb680441 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:21 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-2f23ffe7-6efa-4995-87d7-354ce0003d76 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029c39b7ada54f7b9cb106f054ec8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0706fb42134445cf914a9a00b1042c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:05:21 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-f0e9250f-c6b6-412e-81e7-1c8ccb680441 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.279659 Apr 14 17:05:21 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 40/116] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 17:05:21 2023] GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97/os-interface => generated 282 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:21 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-2f23ffe7-6efa-4995-87d7-354ce0003d76 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '029c39b7ada54f7b9cb106f054ec8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0706fb42134445cf914a9a00b1042c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:05:21 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-2f23ffe7-6efa-4995-87d7-354ce0003d76 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '029c39b7ada54f7b9cb106f054ec8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0706fb42134445cf914a9a00b1042c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:05:21 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-2f23ffe7-6efa-4995-87d7-354ce0003d76 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58" status: 200 len: 2822 microversion: 2.32 time: 0.540439 Apr 14 17:05:21 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 39/117] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:05:21 2023] GET /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58 => generated 2822 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:05:21 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-930714cd-e56c-4852-aa6c-0ddfd90999b9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.639706 Apr 14 17:05:21 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 39/118] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 17:05:21 2023] GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1/os-interface => generated 283 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:22 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-8ad47a7c-a9b1-4f76-93a2-b2dcc6affa94 req-a1fe0a59-cda9-47aa-9ce9-f4ee3c8d5a23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8ad47a7c-a9b1-4f76-93a2-b2dcc6affa94 req-a1fe0a59-cda9-47aa-9ce9-f4ee3c8d5a23 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8ad47a7c-a9b1-4f76-93a2-b2dcc6affa94 req-a1fe0a59-cda9-47aa-9ce9-f4ee3c8d5a23 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8ad47a7c-a9b1-4f76-93a2-b2dcc6affa94 req-a1fe0a59-cda9-47aa-9ce9-f4ee3c8d5a23 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:22 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-8ad47a7c-a9b1-4f76-93a2-b2dcc6affa94 req-a1fe0a59-cda9-47aa-9ce9-f4ee3c8d5a23 service nova] Creating event network-changed:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:05:22 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-8ad47a7c-a9b1-4f76-93a2-b2dcc6affa94 req-a1fe0a59-cda9-47aa-9ce9-f4ee3c8d5a23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042351 Apr 14 17:05:22 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 41/119] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:22 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a9aa4da6-6d21-4961-97e7-d753892e8a10 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:22 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-a9aa4da6-6d21-4961-97e7-d753892e8a10 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a9aa4da6-6d21-4961-97e7-d753892e8a10 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a9aa4da6-6d21-4961-97e7-d753892e8a10 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a9aa4da6-6d21-4961-97e7-d753892e8a10 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a9aa4da6-6d21-4961-97e7-d753892e8a10 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a9aa4da6-6d21-4961-97e7-d753892e8a10 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a9aa4da6-6d21-4961-97e7-d753892e8a10 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:22 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-a9aa4da6-6d21-4961-97e7-d753892e8a10 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97/ips" status: 200 len: 103 microversion: 2.1 time: 0.085214 Apr 14 17:05:22 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 40/120] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 17:05:22 2023] GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97/ips => generated 103 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:23 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-037fbc3c-7dcc-40c5-a5f0-cd9e54ed0e63 req-45ceaff3-6f7c-4aa8-b488-90fcf86955e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7465a41f-c916-4cca-8084-7c646409007d", "tag": "94c17c3d-5fae-4403-bc19-875a6a0ff264"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-037fbc3c-7dcc-40c5-a5f0-cd9e54ed0e63 req-45ceaff3-6f7c-4aa8-b488-90fcf86955e8 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-037fbc3c-7dcc-40c5-a5f0-cd9e54ed0e63 req-45ceaff3-6f7c-4aa8-b488-90fcf86955e8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-037fbc3c-7dcc-40c5-a5f0-cd9e54ed0e63 req-45ceaff3-6f7c-4aa8-b488-90fcf86955e8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:23 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-037fbc3c-7dcc-40c5-a5f0-cd9e54ed0e63 req-45ceaff3-6f7c-4aa8-b488-90fcf86955e8 service nova] Creating event network-changed:94c17c3d-5fae-4403-bc19-875a6a0ff264 for instance 7465a41f-c916-4cca-8084-7c646409007d on user Apr 14 17:05:23 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-037fbc3c-7dcc-40c5-a5f0-cd9e54ed0e63 req-45ceaff3-6f7c-4aa8-b488-90fcf86955e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043616 Apr 14 17:05:23 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 40/121] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:23 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-b795ac31-d1cd-43cc-8969-87929be5619e req-1c454875-77da-4eb9-8557-ab3f447f678b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0488788-7b88-4c48-9fcd-02640c09feb1", "tag": "adb6bafa-17f9-4c4e-af68-632cc59c3a03"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-b795ac31-d1cd-43cc-8969-87929be5619e req-1c454875-77da-4eb9-8557-ab3f447f678b service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-b795ac31-d1cd-43cc-8969-87929be5619e req-1c454875-77da-4eb9-8557-ab3f447f678b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-b795ac31-d1cd-43cc-8969-87929be5619e req-1c454875-77da-4eb9-8557-ab3f447f678b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:23 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-b795ac31-d1cd-43cc-8969-87929be5619e req-1c454875-77da-4eb9-8557-ab3f447f678b service nova] Creating event network-changed:adb6bafa-17f9-4c4e-af68-632cc59c3a03 for instance c0488788-7b88-4c48-9fcd-02640c09feb1 on user Apr 14 17:05:23 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-ffd80b9b-a1e2-434a-bcde-087ad758e708 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:23 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-ffd80b9b-a1e2-434a-bcde-087ad758e708 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:23 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-b795ac31-d1cd-43cc-8969-87929be5619e req-1c454875-77da-4eb9-8557-ab3f447f678b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041136 Apr 14 17:05:23 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 42/122] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ffd80b9b-a1e2-434a-bcde-087ad758e708 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ffd80b9b-a1e2-434a-bcde-087ad758e708 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ffd80b9b-a1e2-434a-bcde-087ad758e708 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ffd80b9b-a1e2-434a-bcde-087ad758e708 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ffd80b9b-a1e2-434a-bcde-087ad758e708 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ffd80b9b-a1e2-434a-bcde-087ad758e708 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:24 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-ffd80b9b-a1e2-434a-bcde-087ad758e708 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1/ips" status: 200 len: 109 microversion: 2.1 time: 0.441494 Apr 14 17:05:24 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 41/123] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 17:05:23 2023] GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1/ips => generated 109 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:24 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a9afda8-f50a-4ca3-899b-7f3d33cbd9eb"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:24 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:24 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:24 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:24 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:24 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:24 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:24 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:25 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-2eda87b3-e668-45d6-8f41-b1b610890e96 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.413327 Apr 14 17:05:25 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 41/124] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:05:24 2023] POST /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:25 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ef40a58-0f55-4cad-9da8-5f08f9070aaf"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:25 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:25 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-5b002d2a-4729-40fa-a4eb-e5923420538d req-97376db6-d158-4a9e-8bd3-7facfd3fcede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7465a41f-c916-4cca-8084-7c646409007d", "name": "network-vif-plugged", "status": "completed", "tag": "94c17c3d-5fae-4403-bc19-875a6a0ff264"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5b002d2a-4729-40fa-a4eb-e5923420538d req-97376db6-d158-4a9e-8bd3-7facfd3fcede service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5b002d2a-4729-40fa-a4eb-e5923420538d req-97376db6-d158-4a9e-8bd3-7facfd3fcede service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5b002d2a-4729-40fa-a4eb-e5923420538d req-97376db6-d158-4a9e-8bd3-7facfd3fcede service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:25 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-5b002d2a-4729-40fa-a4eb-e5923420538d req-97376db6-d158-4a9e-8bd3-7facfd3fcede service nova] Creating event network-vif-plugged:94c17c3d-5fae-4403-bc19-875a6a0ff264 for instance 7465a41f-c916-4cca-8084-7c646409007d on user Apr 14 17:05:25 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-5b002d2a-4729-40fa-a4eb-e5923420538d req-97376db6-d158-4a9e-8bd3-7facfd3fcede service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043817 Apr 14 17:05:25 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 42/125] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:26 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-a2124ac8-15b4-4281-b428-dd2dbd053124 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.706245 Apr 14 17:05:26 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 43/126] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:05:25 2023] POST /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97/os-volume_attachments => generated 194 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:26 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58c68d43-05ee-458b-b7d0-8bc859d6ebcb"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:26 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:27 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-dc5e106a-5721-402c-bc72-f84c781df627 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319721 Apr 14 17:05:27 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 42/127] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:05:26 2023] POST /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:27 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-4c285a95-713d-47e8-af39-b39993c947b9 req-4e6a9af5-247a-4d8d-b6a6-73c88d477128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7465a41f-c916-4cca-8084-7c646409007d", "name": "network-vif-plugged", "status": "completed", "tag": "94c17c3d-5fae-4403-bc19-875a6a0ff264"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-4c285a95-713d-47e8-af39-b39993c947b9 req-4e6a9af5-247a-4d8d-b6a6-73c88d477128 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-4c285a95-713d-47e8-af39-b39993c947b9 req-4e6a9af5-247a-4d8d-b6a6-73c88d477128 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-4c285a95-713d-47e8-af39-b39993c947b9 req-4e6a9af5-247a-4d8d-b6a6-73c88d477128 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:27 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-4c285a95-713d-47e8-af39-b39993c947b9 req-4e6a9af5-247a-4d8d-b6a6-73c88d477128 service nova] Creating event network-vif-plugged:94c17c3d-5fae-4403-bc19-875a6a0ff264 for instance 7465a41f-c916-4cca-8084-7c646409007d on user Apr 14 17:05:27 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-4c285a95-713d-47e8-af39-b39993c947b9 req-4e6a9af5-247a-4d8d-b6a6-73c88d477128 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036750 Apr 14 17:05:27 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 43/128] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:31 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:05:31 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-da93f57e-6f73-43d2-b9f2-858acec23405 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:31 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-da93f57e-6f73-43d2-b9f2-858acec23405 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-da93f57e-6f73-43d2-b9f2-858acec23405 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-da93f57e-6f73-43d2-b9f2-858acec23405 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-da93f57e-6f73-43d2-b9f2-858acec23405 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-da93f57e-6f73-43d2-b9f2-858acec23405 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-da93f57e-6f73-43d2-b9f2-858acec23405 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-da93f57e-6f73-43d2-b9f2-858acec23405 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:31 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-da93f57e-6f73-43d2-b9f2-858acec23405 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.321963 Apr 14 17:05:31 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 44/129] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 17:05:31 2023] GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd/os-interface => generated 282 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:32 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:05:32 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:05:32 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-f29810af-44b5-47e2-b58d-5a7856b84832 req-51c6f99f-a6d7-4350-b4a3-e9820ab7504f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5920661-9030-4cf7-88a0-1ad789eec1bd", "tag": "526282d7-c5ce-4ae0-9745-4e43477222f0"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:32 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-f29810af-44b5-47e2-b58d-5a7856b84832 req-51c6f99f-a6d7-4350-b4a3-e9820ab7504f service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:32 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-f29810af-44b5-47e2-b58d-5a7856b84832 req-51c6f99f-a6d7-4350-b4a3-e9820ab7504f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:32 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-f29810af-44b5-47e2-b58d-5a7856b84832 req-51c6f99f-a6d7-4350-b4a3-e9820ab7504f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:32 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-f29810af-44b5-47e2-b58d-5a7856b84832 req-51c6f99f-a6d7-4350-b4a3-e9820ab7504f service nova] Creating event network-changed:526282d7-c5ce-4ae0-9745-4e43477222f0 for instance d5920661-9030-4cf7-88a0-1ad789eec1bd on user Apr 14 17:05:32 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-f29810af-44b5-47e2-b58d-5a7856b84832 req-51c6f99f-a6d7-4350-b4a3-e9820ab7504f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045687 Apr 14 17:05:32 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 43/130] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:32 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-2021713091"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:32 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:32 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:32 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:32 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Going to try to terminate instance {{(pid=61935) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:05:33 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-00518290-ef25-42d0-9aac-5cf9e762f8e4 tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e" status: 204 len: 0 microversion: 2.1 time: 0.130594 Apr 14 17:05:33 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 45/131] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:05:32 2023] DELETE /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:05:33 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-4fe1d93d-aa51-41c3-858f-c745de4d514b tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:33 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-4fe1d93d-aa51-41c3-858f-c745de4d514b tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4fe1d93d-aa51-41c3-858f-c745de4d514b tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4fe1d93d-aa51-41c3-858f-c745de4d514b tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4fe1d93d-aa51-41c3-858f-c745de4d514b tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4fe1d93d-aa51-41c3-858f-c745de4d514b tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4fe1d93d-aa51-41c3-858f-c745de4d514b tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4fe1d93d-aa51-41c3-858f-c745de4d514b tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:33 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-66535754-4d4c-4d4a-b7a9-b5ac040c445d req-c5453fe7-eda6-46bc-90de-492eea598e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e707b44-e838-4494-9fbc-5698e755e09e", "name": "network-vif-unplugged", "status": "completed", "tag": "5572c41c-64e8-4058-9a5e-f3a994e78787"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:33 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-4fe1d93d-aa51-41c3-858f-c745de4d514b tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d636ab92c4700b480ea58ce6a30ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762a37326f89466c9ee3714ea2e2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:05:33 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-66535754-4d4c-4d4a-b7a9-b5ac040c445d req-c5453fe7-eda6-46bc-90de-492eea598e9a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:33 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-66535754-4d4c-4d4a-b7a9-b5ac040c445d req-c5453fe7-eda6-46bc-90de-492eea598e9a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:33 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-66535754-4d4c-4d4a-b7a9-b5ac040c445d req-c5453fe7-eda6-46bc-90de-492eea598e9a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:33 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-66535754-4d4c-4d4a-b7a9-b5ac040c445d req-c5453fe7-eda6-46bc-90de-492eea598e9a service nova] Creating event network-vif-unplugged:5572c41c-64e8-4058-9a5e-f3a994e78787 for instance 6e707b44-e838-4494-9fbc-5698e755e09e on user Apr 14 17:05:33 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-66535754-4d4c-4d4a-b7a9-b5ac040c445d req-c5453fe7-eda6-46bc-90de-492eea598e9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051330 Apr 14 17:05:33 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 46/132] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:33 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-4fe1d93d-aa51-41c3-858f-c745de4d514b tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e" status: 200 len: 1542 microversion: 2.1 time: 0.533015 Apr 14 17:05:33 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 44/133] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:05:33 2023] GET /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e => generated 1542 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:05:34 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-19cff313-c33c-40ab-b227-9579d7d33e92 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd/action" status: 202 len: 0 microversion: 2.1 time: 1.187065 Apr 14 17:05:34 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 44/134] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:05:32 2023] POST /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd/action => generated 0 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 17:05:34 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-9eb8347f-adf2-4732-80fc-1beb7a2ad0a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '.version_select at 0x7fe19d3d8160>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:34 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-9eb8347f-adf2-4732-80fc-1beb7a2ad0a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "GET /compute/v2.1/images/76d1cc2c-f73e-47b3-a798-4adb640ecdc8" status: 200 len: 1609 microversion: 2.1 time: 0.072201 Apr 14 17:05:34 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 47/135] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 17:05:34 2023] GET /compute/v2.1/images/76d1cc2c-f73e-47b3-a798-4adb640ecdc8 => generated 1609 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:05:35 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-7c448c80-61e1-44cc-884b-b44f74f14b49 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7c448c80-61e1-44cc-884b-b44f74f14b49 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7c448c80-61e1-44cc-884b-b44f74f14b49 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7c448c80-61e1-44cc-884b-b44f74f14b49 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:35 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-7c448c80-61e1-44cc-884b-b44f74f14b49 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Going to try to stop instance {{(pid=61933) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 17:05:35 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-7c448c80-61e1-44cc-884b-b44f74f14b49 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97/action" status: 202 len: 0 microversion: 2.1 time: 0.245292 Apr 14 17:05:35 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 45/136] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:05:35 2023] POST /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:05:35 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-afde0cfd-182f-4c40-997a-e5324fb1f870 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:35 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-afde0cfd-182f-4c40-997a-e5324fb1f870 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-afde0cfd-182f-4c40-997a-e5324fb1f870 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-afde0cfd-182f-4c40-997a-e5324fb1f870 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-afde0cfd-182f-4c40-997a-e5324fb1f870 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-afde0cfd-182f-4c40-997a-e5324fb1f870 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-afde0cfd-182f-4c40-997a-e5324fb1f870 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-afde0cfd-182f-4c40-997a-e5324fb1f870 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:35 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-3898d6a9-225a-4685-8a1e-c2685a11c128 req-62579174-c7f9-4b36-9af6-e492d5f44f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e707b44-e838-4494-9fbc-5698e755e09e", "name": "network-vif-plugged", "status": "completed", "tag": "5572c41c-64e8-4058-9a5e-f3a994e78787"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:35 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3898d6a9-225a-4685-8a1e-c2685a11c128 req-62579174-c7f9-4b36-9af6-e492d5f44f3d service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:35 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3898d6a9-225a-4685-8a1e-c2685a11c128 req-62579174-c7f9-4b36-9af6-e492d5f44f3d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:35 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3898d6a9-225a-4685-8a1e-c2685a11c128 req-62579174-c7f9-4b36-9af6-e492d5f44f3d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:35 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-3898d6a9-225a-4685-8a1e-c2685a11c128 req-62579174-c7f9-4b36-9af6-e492d5f44f3d service nova] Creating event network-vif-plugged:5572c41c-64e8-4058-9a5e-f3a994e78787 for instance 6e707b44-e838-4494-9fbc-5698e755e09e on user Apr 14 17:05:35 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-3898d6a9-225a-4685-8a1e-c2685a11c128 req-62579174-c7f9-4b36-9af6-e492d5f44f3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062900 Apr 14 17:05:35 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 48/137] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:35 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-afde0cfd-182f-4c40-997a-e5324fb1f870 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c4734925f645248b0f9060aa78a502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8f6b39515e456c9f5a1affa9f79000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:05:35 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-afde0cfd-182f-4c40-997a-e5324fb1f870 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97" status: 200 len: 1710 microversion: 2.1 time: 0.475050 Apr 14 17:05:35 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 45/138] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:05:35 2023] GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97 => generated 1710 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:05:36 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-ea66e9cd-69de-4f26-a863-39cb2c23efe0 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Action: 'create', calling method: .version_select at 0x7fe19d206b90>, body: {"keypair": {"name": "tempest-keypair-122500492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+Zm1ctsV4wvEsTcBuyV4czpQkG0nl/+xyA5iP1tq9gjgmi51R5vjpJ5uOCEzngZBoovymkqc8E81yq7xGrxfiaEQcdxPLfkSbxVyw8dAp1esxCIm+M5nPc8fDIlB6wQ=="}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:36 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-ea66e9cd-69de-4f26-a863-39cb2c23efe0 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting quotas for project 6f341a2096b9483787b569a59f325556. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:05:36 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-ea66e9cd-69de-4f26-a863-39cb2c23efe0 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting quotas for user d9c9e0d318eb4ca49d47d620682fb00a and project 6f341a2096b9483787b569a59f325556. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:05:36 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-ea66e9cd-69de-4f26-a863-39cb2c23efe0 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.101304 Apr 14 17:05:36 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 46/139] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 17:05:36 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:36 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-0615dfdd-a261-45b1-ace7-d51f9738e986 req-21e0dec8-eed8-4fd8-b8f5-c993684859fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e707b44-e838-4494-9fbc-5698e755e09e", "name": "network-vif-deleted", "tag": "5572c41c-64e8-4058-9a5e-f3a994e78787"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-0615dfdd-a261-45b1-ace7-d51f9738e986 req-21e0dec8-eed8-4fd8-b8f5-c993684859fd service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-0615dfdd-a261-45b1-ace7-d51f9738e986 req-21e0dec8-eed8-4fd8-b8f5-c993684859fd service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-0615dfdd-a261-45b1-ace7-d51f9738e986 req-21e0dec8-eed8-4fd8-b8f5-c993684859fd service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:36 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-0615dfdd-a261-45b1-ace7-d51f9738e986 req-21e0dec8-eed8-4fd8-b8f5-c993684859fd service nova] Creating event network-vif-deleted:5572c41c-64e8-4058-9a5e-f3a994e78787 for instance 6e707b44-e838-4494-9fbc-5698e755e09e on user Apr 14 17:05:36 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-0615dfdd-a261-45b1-ace7-d51f9738e986 req-21e0dec8-eed8-4fd8-b8f5-c993684859fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084438 Apr 14 17:05:36 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 49/140] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:37 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "name": "network-vif-unplugged", "status": "completed", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}, {"server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "name": "network-vif-plugged", "status": "completed", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:37 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:37 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:37 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:37 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] Creating event network-vif-unplugged:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:05:37 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] Creating event network-vif-plugged:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:05:37 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-f7258607-8a7a-41f0-ad62-0814933afc94 req-e6c9b270-621f-42bc-bbc0-67c80a87b27d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.040942 Apr 14 17:05:37 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 46/141] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:37 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:38 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1521815605", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "06f3eb05-9ead-4131-b955-af3bc09e9758"}], "security_groups": [{"name": "tempest-securitygroup--1199137388"}], "key_name": "tempest-keypair-122500492", "user_data": "}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:38 user devstack@n-api.service[61933]: DEBUG nova.network.neutron [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] validate_networks() for [('06f3eb05-9ead-4131-b955-af3bc09e9758', None, None, None, None, None)] {{(pid=61933) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:05:39 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flavor limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:05:39 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Image limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:05:39 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flavor pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:05:39 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Image pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:05:39 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:05:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:39 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting quotas for project 6f341a2096b9483787b569a59f325556. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:05:39 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting quotas for user d9c9e0d318eb4ca49d47d620682fb00a and project 6f341a2096b9483787b569a59f325556. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:05:39 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Going to run 1 instances... {{(pid=61933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:05:39 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:05:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-592713ab-caf1-41fe-8be3-a573b8551dd2 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.687118 Apr 14 17:05:39 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 47/142] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:05:38 2023] POST /compute/v2.1/servers => generated 400 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:05:39 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-cf9fb733-58a8-4132-af01-538595da3ad8 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:39 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-cf9fb733-58a8-4132-af01-538595da3ad8 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:39 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-cf9fb733-58a8-4132-af01-538595da3ad8 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c9e0d318eb4ca49d47d620682fb00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f341a2096b9483787b569a59f325556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:05:39 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-cf9fb733-58a8-4132-af01-538595da3ad8 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd" status: 200 len: 1235 microversion: 2.1 time: 0.062242 Apr 14 17:05:39 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 50/143] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:05:39 2023] GET /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd => generated 1235 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:05:41 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-70745315-b75f-4490-a0b8-669a3cba03a5 req-47b33a3f-a62f-45ad-a66b-2c1c512c577e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3469a45b-e63a-4871-a6c5-deece7f4ecfd", "tag": "4674caf0-77c1-4de1-a665-db3fde68e9bb"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-70745315-b75f-4490-a0b8-669a3cba03a5 req-47b33a3f-a62f-45ad-a66b-2c1c512c577e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-70745315-b75f-4490-a0b8-669a3cba03a5 req-47b33a3f-a62f-45ad-a66b-2c1c512c577e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-70745315-b75f-4490-a0b8-669a3cba03a5 req-47b33a3f-a62f-45ad-a66b-2c1c512c577e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:42 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-70745315-b75f-4490-a0b8-669a3cba03a5 req-47b33a3f-a62f-45ad-a66b-2c1c512c577e service nova] Creating event network-changed:4674caf0-77c1-4de1-a665-db3fde68e9bb for instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd on user Apr 14 17:05:42 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-70745315-b75f-4490-a0b8-669a3cba03a5 req-47b33a3f-a62f-45ad-a66b-2c1c512c577e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033225 Apr 14 17:05:42 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 47/144] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:42 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-03f435cd-f18f-4ed7-85d4-8bdd047c2b6e tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:42 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-03f435cd-f18f-4ed7-85d4-8bdd047c2b6e tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-03f435cd-f18f-4ed7-85d4-8bdd047c2b6e tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-03f435cd-f18f-4ed7-85d4-8bdd047c2b6e tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-03f435cd-f18f-4ed7-85d4-8bdd047c2b6e tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-03f435cd-f18f-4ed7-85d4-8bdd047c2b6e tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-03f435cd-f18f-4ed7-85d4-8bdd047c2b6e tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-03f435cd-f18f-4ed7-85d4-8bdd047c2b6e tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:43 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-03f435cd-f18f-4ed7-85d4-8bdd047c2b6e tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.417974 Apr 14 17:05:43 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 48/145] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 17:05:42 2023] GET /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4/os-interface => generated 282 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:44 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-2cd51de0-e1d2-4263-b5b6-9246022f8705 req-3a959921-51e9-4d3d-97a6-79f72506af11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add03bde-bc0e-436a-a994-e81c3f75e4c4", "tag": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:44 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2cd51de0-e1d2-4263-b5b6-9246022f8705 req-3a959921-51e9-4d3d-97a6-79f72506af11 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:44 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2cd51de0-e1d2-4263-b5b6-9246022f8705 req-3a959921-51e9-4d3d-97a6-79f72506af11 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:44 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2cd51de0-e1d2-4263-b5b6-9246022f8705 req-3a959921-51e9-4d3d-97a6-79f72506af11 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:44 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-2cd51de0-e1d2-4263-b5b6-9246022f8705 req-3a959921-51e9-4d3d-97a6-79f72506af11 service nova] Creating event network-changed:0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance add03bde-bc0e-436a-a994-e81c3f75e4c4 on user Apr 14 17:05:44 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-2cd51de0-e1d2-4263-b5b6-9246022f8705 req-3a959921-51e9-4d3d-97a6-79f72506af11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035138 Apr 14 17:05:44 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 51/146] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:44 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-19177107-9dd9-41fb-a19b-10fa0bdd717d req-acf7daff-220a-44da-bf62-36430b088ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3469a45b-e63a-4871-a6c5-deece7f4ecfd", "name": "network-vif-plugged", "status": "completed", "tag": "4674caf0-77c1-4de1-a665-db3fde68e9bb"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-19177107-9dd9-41fb-a19b-10fa0bdd717d req-acf7daff-220a-44da-bf62-36430b088ca6 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-19177107-9dd9-41fb-a19b-10fa0bdd717d req-acf7daff-220a-44da-bf62-36430b088ca6 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-19177107-9dd9-41fb-a19b-10fa0bdd717d req-acf7daff-220a-44da-bf62-36430b088ca6 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:44 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-19177107-9dd9-41fb-a19b-10fa0bdd717d req-acf7daff-220a-44da-bf62-36430b088ca6 service nova] Creating event network-vif-plugged:4674caf0-77c1-4de1-a665-db3fde68e9bb for instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd on user Apr 14 17:05:44 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-19177107-9dd9-41fb-a19b-10fa0bdd717d req-acf7daff-220a-44da-bf62-36430b088ca6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032776 Apr 14 17:05:44 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 48/147] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:46 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-ae8e26db-dfbf-4a90-94c2-947d18666ef8 req-f361be53-bac2-425d-93f2-80120091b727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3469a45b-e63a-4871-a6c5-deece7f4ecfd", "name": "network-vif-plugged", "status": "completed", "tag": "4674caf0-77c1-4de1-a665-db3fde68e9bb"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ae8e26db-dfbf-4a90-94c2-947d18666ef8 req-f361be53-bac2-425d-93f2-80120091b727 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ae8e26db-dfbf-4a90-94c2-947d18666ef8 req-f361be53-bac2-425d-93f2-80120091b727 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ae8e26db-dfbf-4a90-94c2-947d18666ef8 req-f361be53-bac2-425d-93f2-80120091b727 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-ae8e26db-dfbf-4a90-94c2-947d18666ef8 req-f361be53-bac2-425d-93f2-80120091b727 service nova] Creating event network-vif-plugged:4674caf0-77c1-4de1-a665-db3fde68e9bb for instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd on user Apr 14 17:05:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-ae8e26db-dfbf-4a90-94c2-947d18666ef8 req-f361be53-bac2-425d-93f2-80120091b727 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032427 Apr 14 17:05:46 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 49/148] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:46 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4614e3e7-fd7a-4c08-97f7-c83cf4e18c46"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:46 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:47 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-392ad472-f6e0-4dca-bbff-e08f28baa92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "POST /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304722 Apr 14 17:05:47 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 52/149] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:05:46 2023] POST /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:47 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-88b69cd7-79ba-4350-bf4b-55671f6f4de3 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:47 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-88b69cd7-79ba-4350-bf4b-55671f6f4de3 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-88b69cd7-79ba-4350-bf4b-55671f6f4de3 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-88b69cd7-79ba-4350-bf4b-55671f6f4de3 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-88b69cd7-79ba-4350-bf4b-55671f6f4de3 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-88b69cd7-79ba-4350-bf4b-55671f6f4de3 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-88b69cd7-79ba-4350-bf4b-55671f6f4de3 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-88b69cd7-79ba-4350-bf4b-55671f6f4de3 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:47 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-88b69cd7-79ba-4350-bf4b-55671f6f4de3 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.184416 Apr 14 17:05:47 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 49/150] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 17:05:47 2023] GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/os-interface => generated 282 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:48 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-ed497e93-2ce9-4773-9a96-c3f898cb65a5 req-5c5d919f-0b6f-42d2-81f6-191c4ec347d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80bd1dd9-b80e-4533-98d5-0ca798bc4be9", "tag": "3c8c7d04-4fcc-498a-b858-122cea028627"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ed497e93-2ce9-4773-9a96-c3f898cb65a5 req-5c5d919f-0b6f-42d2-81f6-191c4ec347d9 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ed497e93-2ce9-4773-9a96-c3f898cb65a5 req-5c5d919f-0b6f-42d2-81f6-191c4ec347d9 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ed497e93-2ce9-4773-9a96-c3f898cb65a5 req-5c5d919f-0b6f-42d2-81f6-191c4ec347d9 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:48 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-ed497e93-2ce9-4773-9a96-c3f898cb65a5 req-5c5d919f-0b6f-42d2-81f6-191c4ec347d9 service nova] Creating event network-changed:3c8c7d04-4fcc-498a-b858-122cea028627 for instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 on user Apr 14 17:05:48 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-ed497e93-2ce9-4773-9a96-c3f898cb65a5 req-5c5d919f-0b6f-42d2-81f6-191c4ec347d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034372 Apr 14 17:05:48 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 50/151] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 17:05:49 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:05:49 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-0bf55c74-a54a-4bb0-b94b-99a74c470bab tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:49 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-0bf55c74-a54a-4bb0-b94b-99a74c470bab tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0bf55c74-a54a-4bb0-b94b-99a74c470bab tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0bf55c74-a54a-4bb0-b94b-99a74c470bab tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0bf55c74-a54a-4bb0-b94b-99a74c470bab tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0bf55c74-a54a-4bb0-b94b-99a74c470bab tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0bf55c74-a54a-4bb0-b94b-99a74c470bab tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0bf55c74-a54a-4bb0-b94b-99a74c470bab tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:49 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-0bf55c74-a54a-4bb0-b94b-99a74c470bab tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.189663 Apr 14 17:05:49 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 53/152] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 17:05:49 2023] GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-interface => generated 282 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:50 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-e6c65bbf-0e85-4fa4-98d6-97a5c45e804c req-2c829698-6d9f-4883-a63b-ac9c9f905f75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f53cfe1f-c915-4a74-8512-84a97147f1d1", "tag": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-e6c65bbf-0e85-4fa4-98d6-97a5c45e804c req-2c829698-6d9f-4883-a63b-ac9c9f905f75 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-e6c65bbf-0e85-4fa4-98d6-97a5c45e804c req-2c829698-6d9f-4883-a63b-ac9c9f905f75 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-e6c65bbf-0e85-4fa4-98d6-97a5c45e804c req-2c829698-6d9f-4883-a63b-ac9c9f905f75 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:50 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-e6c65bbf-0e85-4fa4-98d6-97a5c45e804c req-2c829698-6d9f-4883-a63b-ac9c9f905f75 service nova] Creating event network-changed:dfe61768-29ed-4753-b77a-dcc14e1ce6c2 for instance f53cfe1f-c915-4a74-8512-84a97147f1d1 on user Apr 14 17:05:50 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-e6c65bbf-0e85-4fa4-98d6-97a5c45e804c req-2c829698-6d9f-4883-a63b-ac9c9f905f75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062160 Apr 14 17:05:50 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 50/153] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:50 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:05:50 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=10 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:05:50 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3efe6a50-62c4-4eae-a012-2d4a71faa73f"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:50 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:50 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=7 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:05:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:50 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:05:51 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-ecef27bb-88d1-4497-b85c-e57e83134c00 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322833 Apr 14 17:05:51 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 51/154] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:05:50 2023] POST /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:51 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:51 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:51 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:05:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:51 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:05:51 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-3aa1c007-c9d6-4688-b62f-af9c584c196e tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] 10.0.0.210 "POST /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302805 Apr 14 17:05:51 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 54/155] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:05:51 2023] POST /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:54 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b28bf3f1-dff9-4c03-9954-bcfc0288bf71 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:54 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-b28bf3f1-dff9-4c03-9954-bcfc0288bf71 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b28bf3f1-dff9-4c03-9954-bcfc0288bf71 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b28bf3f1-dff9-4c03-9954-bcfc0288bf71 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b28bf3f1-dff9-4c03-9954-bcfc0288bf71 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b28bf3f1-dff9-4c03-9954-bcfc0288bf71 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b28bf3f1-dff9-4c03-9954-bcfc0288bf71 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b28bf3f1-dff9-4c03-9954-bcfc0288bf71 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:54 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-2871ed46-bf99-4661-abb9-9150a676b103 tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "479b912e-fb2e-4ef3-b165-c991ecd12c89"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:54 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-2871ed46-bf99-4661-abb9-9150a676b103 tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:55 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=26 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:05:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2871ed46-bf99-4661-abb9-9150a676b103 tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2871ed46-bf99-4661-abb9-9150a676b103 tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2871ed46-bf99-4661-abb9-9150a676b103 tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2871ed46-bf99-4661-abb9-9150a676b103 tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2871ed46-bf99-4661-abb9-9150a676b103 tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2871ed46-bf99-4661-abb9-9150a676b103 tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:55 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:05:55 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-2871ed46-bf99-4661-abb9-9150a676b103 tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] HTTP exception thrown: Volume 479b912e-fb2e-4ef3-b165-c991ecd12c89 could not be found. Apr 14 17:05:55 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-2871ed46-bf99-4661-abb9-9150a676b103 tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] Request method failure captured: Apr 14 17:05:55 user devstack@n-api.service[61934]: request: PUT /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4/os-volume_attachments/4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 HTTP/1.1 Apr 14 17:05:55 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:05:55 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:05:55 user devstack@n-api.service[61934]: Connection: close Apr 14 17:05:55 user devstack@n-api.service[61934]: Content-Length: 74 Apr 14 17:05:55 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:05:55 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:05:55 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:05:55 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:05:55 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYdubvCYX2Cmnzxk7hGyuAE02UUuwRlbwTYXr8c_v4kDmEvecz_6uiLOel7WsgwVWKubIpUzyYwFFpVJC8qnxiUgMk92ndqBj5JzHw48-1NHydbCk7q-wICKOvRfVf9zGy63xSctfu6Oy_Xw-b0bll8H4fs4FTUQ5WP2Iv8a4ficOEs Apr 14 17:05:55 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:05:55 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:05:55 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:05:55 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:05:55 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:05:55 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:05:55 user devstack@n-api.service[61934]: X-Project-Id: 08b9e10c360d4d8b99347aa1c1641fc3 Apr 14 17:05:55 user devstack@n-api.service[61934]: X-Project-Name: tempest-VolumesAdminNegativeTest-1384105653 Apr 14 17:05:55 user devstack@n-api.service[61934]: X-Role: admin,reader,member Apr 14 17:05:55 user devstack@n-api.service[61934]: X-Roles: admin,reader,member Apr 14 17:05:55 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/08b9e10c360d4d8b99347aa1c1641fc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/08b9e10c360d4d8b99347aa1c1641fc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/08b9e10c360d4d8b99347aa1c1641fc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:05:55 user devstack@n-api.service[61934]: X-Tenant: tempest-VolumesAdminNegativeTest-1384105653 Apr 14 17:05:55 user devstack@n-api.service[61934]: X-Tenant-Id: 08b9e10c360d4d8b99347aa1c1641fc3 Apr 14 17:05:55 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1384105653 Apr 14 17:05:55 user devstack@n-api.service[61934]: X-User: tempest-VolumesAdminNegativeTest-1384105653-project-admin Apr 14 17:05:55 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:05:55 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:05:55 user devstack@n-api.service[61934]: X-User-Id: cca04a858af34b5a96f3cedbc898e500 Apr 14 17:05:55 user devstack@n-api.service[61934]: X-User-Name: tempest-VolumesAdminNegativeTest-1384105653-project-admin Apr 14 17:05:55 user devstack@n-api.service[61934]: Apr 14 17:05:55 user devstack@n-api.service[61934]: {"volumeAttachment": {"volumeId": "479b912e-fb2e-4ef3-b165-c991ecd12c89"}} Apr 14 17:05:55 user devstack@n-api.service[61934]: method: > Apr 14 17:05:55 user devstack@n-api.service[61934]: exception: Volume 479b912e-fb2e-4ef3-b165-c991ecd12c89 could not be found. Apr 14 17:05:55 user devstack@n-api.service[61934]: action_args: {'server_id': 'add03bde-bc0e-436a-a994-e81c3f75e4c4', 'id': '4614e3e7-fd7a-4c08-97f7-c83cf4e18c46', 'body': {'volumeAttachment': {'volumeId': '479b912e-fb2e-4ef3-b165-c991ecd12c89'}}} Apr 14 17:05:55 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 479b912e-fb2e-4ef3-b165-c991ecd12c89 could not be found. (HTTP 404) (Request-ID: req-35a4e3df-aa0a-4003-83a9-8964f7e41086) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 479b912e-fb2e-4ef3-b165-c991ecd12c89 could not be found. Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 479b912e-fb2e-4ef3-b165-c991ecd12c89 could not be found. Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 479b912e-fb2e-4ef3-b165-c991ecd12c89 could not be found. Apr 14 17:05:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:05:55 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-2871ed46-bf99-4661-abb9-9150a676b103 tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] Returning 400 to user: Volume 479b912e-fb2e-4ef3-b165-c991ecd12c89 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:05:55 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-2871ed46-bf99-4661-abb9-9150a676b103 tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4/os-volume_attachments/4614e3e7-fd7a-4c08-97f7-c83cf4e18c46" status: 400 len: 107 microversion: 2.1 time: 0.388330 Apr 14 17:05:55 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 51/156] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 17:05:54 2023] PUT /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4/os-volume_attachments/4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 => generated 107 bytes in 389 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:05:55 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:55 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:55 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-b28bf3f1-dff9-4c03-9954-bcfc0288bf71 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] 10.0.0.210 "GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.467901 Apr 14 17:05:55 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 52/157] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 17:05:54 2023] GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173/os-interface => generated 282 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 17:05:55 user devstack@n-api.service[61935]: DEBUG nova.objects.instance [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lazy-loading 'services' on Instance uuid add03bde-bc0e-436a-a994-e81c3f75e4c4 {{(pid=61935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:05:55 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-2e952473-433c-40eb-a602-8274517d35b1 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4/os-volume_attachments/4614e3e7-fd7a-4c08-97f7-c83cf4e18c46" status: 202 len: 0 microversion: 2.1 time: 0.278262 Apr 14 17:05:55 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 55/158] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:05:55 2023] DELETE /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4/os-volume_attachments/4614e3e7-fd7a-4c08-97f7-c83cf4e18c46 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 17:05:55 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-47941302-bfa5-40be-964c-2016859b870c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:55 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-47941302-bfa5-40be-964c-2016859b870c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-47941302-bfa5-40be-964c-2016859b870c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-47941302-bfa5-40be-964c-2016859b870c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-47941302-bfa5-40be-964c-2016859b870c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-47941302-bfa5-40be-964c-2016859b870c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-47941302-bfa5-40be-964c-2016859b870c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-47941302-bfa5-40be-964c-2016859b870c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:55 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-47941302-bfa5-40be-964c-2016859b870c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099725 Apr 14 17:05:55 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 52/159] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:05:55 2023] GET /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:56 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-74b0f344-de00-4b95-9899-6be9ae7441a6 req-d28da980-83da-4f8f-beb8-09e78182bd49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "113dda5c-a61e-423b-86ea-2fe30a113173", "tag": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-74b0f344-de00-4b95-9899-6be9ae7441a6 req-d28da980-83da-4f8f-beb8-09e78182bd49 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-74b0f344-de00-4b95-9899-6be9ae7441a6 req-d28da980-83da-4f8f-beb8-09e78182bd49 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-74b0f344-de00-4b95-9899-6be9ae7441a6 req-d28da980-83da-4f8f-beb8-09e78182bd49 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:56 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-74b0f344-de00-4b95-9899-6be9ae7441a6 req-d28da980-83da-4f8f-beb8-09e78182bd49 service nova] Creating event network-changed:34ea1bd9-f010-4073-bf8d-351b0e85ceeb for instance 113dda5c-a61e-423b-86ea-2fe30a113173 on user Apr 14 17:05:56 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-74b0f344-de00-4b95-9899-6be9ae7441a6 req-d28da980-83da-4f8f-beb8-09e78182bd49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036566 Apr 14 17:05:56 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 53/160] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:56 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-9e0f2939-05f0-4acc-9c1c-2d86b528d64b tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:05:56 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-9e0f2939-05f0-4acc-9c1c-2d86b528d64b tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9e0f2939-05f0-4acc-9c1c-2d86b528d64b tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9e0f2939-05f0-4acc-9c1c-2d86b528d64b tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9e0f2939-05f0-4acc-9c1c-2d86b528d64b tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9e0f2939-05f0-4acc-9c1c-2d86b528d64b tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9e0f2939-05f0-4acc-9c1c-2d86b528d64b tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9e0f2939-05f0-4acc-9c1c-2d86b528d64b tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:56 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-9e0f2939-05f0-4acc-9c1c-2d86b528d64b tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31588acbcc345519934f4c3a395b0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924256f7ef8c4a5a832a87d1c198c50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:05:56 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-9e0f2939-05f0-4acc-9c1c-2d86b528d64b tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c31588acbcc345519934f4c3a395b0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924256f7ef8c4a5a832a87d1c198c50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:05:56 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-9e0f2939-05f0-4acc-9c1c-2d86b528d64b tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c31588acbcc345519934f4c3a395b0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924256f7ef8c4a5a832a87d1c198c50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:05:56 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-9e0f2939-05f0-4acc-9c1c-2d86b528d64b tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] 10.0.0.210 "GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173" status: 200 len: 1626 microversion: 2.49 time: 0.294723 Apr 14 17:05:56 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 56/161] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:05:56 2023] GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173 => generated 1626 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:05:56 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "fc5fc1b6-6eb8-4e95-8f50-5744bdc58393", "tag": "nic-tag"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:56 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:56 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:56 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:56 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:56 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:56 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:56 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:58 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-bf371485-d2dc-4123-8042-764d35d3f7ac req-e54ec6f1-2041-4c35-acca-ce9f568b302b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "113dda5c-a61e-423b-86ea-2fe30a113173", "tag": "01bf74ae-32c2-4241-9a37-abba15fe3de6"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-bf371485-d2dc-4123-8042-764d35d3f7ac req-e54ec6f1-2041-4c35-acca-ce9f568b302b service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-bf371485-d2dc-4123-8042-764d35d3f7ac req-e54ec6f1-2041-4c35-acca-ce9f568b302b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-bf371485-d2dc-4123-8042-764d35d3f7ac req-e54ec6f1-2041-4c35-acca-ce9f568b302b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-bf371485-d2dc-4123-8042-764d35d3f7ac req-e54ec6f1-2041-4c35-acca-ce9f568b302b service nova] Creating event network-changed:01bf74ae-32c2-4241-9a37-abba15fe3de6 for instance 113dda5c-a61e-423b-86ea-2fe30a113173 on user Apr 14 17:05:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-bf371485-d2dc-4123-8042-764d35d3f7ac req-e54ec6f1-2041-4c35-acca-ce9f568b302b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032713 Apr 14 17:05:58 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 54/162] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:58 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "fa07d38e-7ab2-4439-b17f-e6a139923ab3"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:58 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:59 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-59a81b72-6e08-40ee-b747-4ae961f40e98 tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments/3efe6a50-62c4-4eae-a012-2d4a71faa73f" status: 202 len: 0 microversion: 2.1 time: 0.516544 Apr 14 17:05:59 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 57/163] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 17:05:58 2023] PUT /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments/3efe6a50-62c4-4eae-a012-2d4a71faa73f => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:05:59 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-8a06f93c-ae1b-4b31-a186-74fc422534d9 req-1e7345ff-bc85-4efb-9925-1683319b619c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113dda5c-a61e-423b-86ea-2fe30a113173", "name": "network-vif-plugged", "status": "completed", "tag": "01bf74ae-32c2-4241-9a37-abba15fe3de6"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:59 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-8a06f93c-ae1b-4b31-a186-74fc422534d9 req-1e7345ff-bc85-4efb-9925-1683319b619c service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:59 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-8a06f93c-ae1b-4b31-a186-74fc422534d9 req-1e7345ff-bc85-4efb-9925-1683319b619c service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:59 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-8a06f93c-ae1b-4b31-a186-74fc422534d9 req-1e7345ff-bc85-4efb-9925-1683319b619c service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:59 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-8a06f93c-ae1b-4b31-a186-74fc422534d9 req-1e7345ff-bc85-4efb-9925-1683319b619c service nova] Creating event network-vif-plugged:01bf74ae-32c2-4241-9a37-abba15fe3de6 for instance 113dda5c-a61e-423b-86ea-2fe30a113173 on user Apr 14 17:05:59 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-8a06f93c-ae1b-4b31-a186-74fc422534d9 req-1e7345ff-bc85-4efb-9925-1683319b619c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041337 Apr 14 17:05:59 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 55/164] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:05:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:05:59 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:05:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:05:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:05:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:05:59 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-615bc149-5e16-4627-be5d-6ced93c528f3 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] 10.0.0.210 "POST /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173/os-interface" status: 200 len: 283 microversion: 2.49 time: 3.333831 Apr 14 17:05:59 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 53/165] 10.0.0.210 () {66 vars in 1414 bytes} [Fri Apr 14 17:05:56 2023] POST /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173/os-interface => generated 283 bytes in 3336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 17:05:59 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1460b147-25a9-4883-9e94-a963003b7e58", "tag": "volume-tag"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:05:59 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:00 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-d38665f4-c738-4298-b203-fca211ee098a tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] 10.0.0.210 "POST /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.275353 Apr 14 17:06:00 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 58/166] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 17:05:59 2023] POST /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 17:06:00 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-c472e103-6221-4b86-b70f-af318df373dc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:00 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-c472e103-6221-4b86-b70f-af318df373dc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c472e103-6221-4b86-b70f-af318df373dc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c472e103-6221-4b86-b70f-af318df373dc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c472e103-6221-4b86-b70f-af318df373dc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c472e103-6221-4b86-b70f-af318df373dc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c472e103-6221-4b86-b70f-af318df373dc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c472e103-6221-4b86-b70f-af318df373dc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:00 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-c472e103-6221-4b86-b70f-af318df373dc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057814 Apr 14 17:06:00 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 56/167] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:06:00 2023] GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:00 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:00 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:00 user devstack@n-api.service[61934]: DEBUG nova.objects.instance [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lazy-loading 'services' on Instance uuid 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 {{(pid=61934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:06:00 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-f2783e47-19a6-4e6c-a650-3a9fa92808bc tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/os-volume_attachments/2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed" status: 202 len: 0 microversion: 2.1 time: 0.251738 Apr 14 17:06:00 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 54/168] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:06:00 2023] DELETE /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/os-volume_attachments/2d0e5f99-d3bc-434d-ba68-bfb07b9c96ed => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:06:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-f39dab06-90e8-432e-b84e-7d031a08767a req-b7bb8374-2144-4dc4-bb97-065b682928a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113dda5c-a61e-423b-86ea-2fe30a113173", "name": "network-vif-plugged", "status": "completed", "tag": "01bf74ae-32c2-4241-9a37-abba15fe3de6"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-f39dab06-90e8-432e-b84e-7d031a08767a req-b7bb8374-2144-4dc4-bb97-065b682928a6 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-f39dab06-90e8-432e-b84e-7d031a08767a req-b7bb8374-2144-4dc4-bb97-065b682928a6 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-f39dab06-90e8-432e-b84e-7d031a08767a req-b7bb8374-2144-4dc4-bb97-065b682928a6 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:01 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-f39dab06-90e8-432e-b84e-7d031a08767a req-b7bb8374-2144-4dc4-bb97-065b682928a6 service nova] Creating event network-vif-plugged:01bf74ae-32c2-4241-9a37-abba15fe3de6 for instance 113dda5c-a61e-423b-86ea-2fe30a113173 on user Apr 14 17:06:01 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-f39dab06-90e8-432e-b84e-7d031a08767a req-b7bb8374-2144-4dc4-bb97-065b682928a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031907 Apr 14 17:06:01 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 59/169] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:06:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:04 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-aca02ff9-fd2b-430d-a322-f26b4e022396 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:04 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-aca02ff9-fd2b-430d-a322-f26b4e022396 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-aca02ff9-fd2b-430d-a322-f26b4e022396 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-aca02ff9-fd2b-430d-a322-f26b4e022396 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-aca02ff9-fd2b-430d-a322-f26b4e022396 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-aca02ff9-fd2b-430d-a322-f26b4e022396 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-aca02ff9-fd2b-430d-a322-f26b4e022396 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-aca02ff9-fd2b-430d-a322-f26b4e022396 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:04 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-aca02ff9-fd2b-430d-a322-f26b4e022396 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043757 Apr 14 17:06:04 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 57/170] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:06:04 2023] GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:06:05 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-24f3eba5-3a2b-436f-b112-25ee6af883b2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:05 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-24f3eba5-3a2b-436f-b112-25ee6af883b2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-24f3eba5-3a2b-436f-b112-25ee6af883b2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-24f3eba5-3a2b-436f-b112-25ee6af883b2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-24f3eba5-3a2b-436f-b112-25ee6af883b2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-24f3eba5-3a2b-436f-b112-25ee6af883b2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-24f3eba5-3a2b-436f-b112-25ee6af883b2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-24f3eba5-3a2b-436f-b112-25ee6af883b2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:05 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-24f3eba5-3a2b-436f-b112-25ee6af883b2 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050633 Apr 14 17:06:05 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 55/171] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:06:05 2023] GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:06:05 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:05 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:05 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Going to try to terminate instance {{(pid=61935) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:06:05 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-31aaccca-ec7a-474f-9d9c-eb8f3f7df38d tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9" status: 204 len: 0 microversion: 2.1 time: 0.144905 Apr 14 17:06:05 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 60/172] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:06:05 2023] DELETE /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:06:05 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-48e2c715-f102-41a2-82ec-e986ac515836 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:05 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-48e2c715-f102-41a2-82ec-e986ac515836 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-48e2c715-f102-41a2-82ec-e986ac515836 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-48e2c715-f102-41a2-82ec-e986ac515836 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-48e2c715-f102-41a2-82ec-e986ac515836 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-48e2c715-f102-41a2-82ec-e986ac515836 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-48e2c715-f102-41a2-82ec-e986ac515836 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-48e2c715-f102-41a2-82ec-e986ac515836 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:05 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-48e2c715-f102-41a2-82ec-e986ac515836 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53afcd6995e4e7dbced957359802022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6431ad1110e748baaab4a94037e60782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:06:05 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-48e2c715-f102-41a2-82ec-e986ac515836 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9" status: 200 len: 1674 microversion: 2.1 time: 0.330047 Apr 14 17:06:05 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 58/173] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:06:05 2023] GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9 => generated 1674 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:06:05 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-707b1e60-b8b7-4f43-b929-447a4c349129 req-784566f8-58d5-4833-8dff-836f2d9cce03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bd1dd9-b80e-4533-98d5-0ca798bc4be9", "name": "network-vif-unplugged", "status": "completed", "tag": "3c8c7d04-4fcc-498a-b858-122cea028627"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-707b1e60-b8b7-4f43-b929-447a4c349129 req-784566f8-58d5-4833-8dff-836f2d9cce03 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-707b1e60-b8b7-4f43-b929-447a4c349129 req-784566f8-58d5-4833-8dff-836f2d9cce03 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-707b1e60-b8b7-4f43-b929-447a4c349129 req-784566f8-58d5-4833-8dff-836f2d9cce03 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:05 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-707b1e60-b8b7-4f43-b929-447a4c349129 req-784566f8-58d5-4833-8dff-836f2d9cce03 service nova] Creating event network-vif-unplugged:3c8c7d04-4fcc-498a-b858-122cea028627 for instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 on user Apr 14 17:06:05 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-707b1e60-b8b7-4f43-b929-447a4c349129 req-784566f8-58d5-4833-8dff-836f2d9cce03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030733 Apr 14 17:06:05 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 56/174] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:06:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:07 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:07 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:07 user devstack@n-api.service[61935]: DEBUG nova.objects.instance [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lazy-loading 'services' on Instance uuid 113dda5c-a61e-423b-86ea-2fe30a113173 {{(pid=61935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:06:07 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-230dc2f2-944b-42e4-ac6f-e788b6505803 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173/os-volume_attachments/1460b147-25a9-4883-9e94-a963003b7e58" status: 202 len: 0 microversion: 2.49 time: 0.168360 Apr 14 17:06:07 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 61/175] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 17:06:07 2023] DELETE /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173/os-volume_attachments/1460b147-25a9-4883-9e94-a963003b7e58 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:06:07 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-d7b3a150-6c8d-457d-8210-1b96dac8754b req-e8921637-0381-4a3a-bb11-6bf4668f612a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bd1dd9-b80e-4533-98d5-0ca798bc4be9", "name": "network-vif-plugged", "status": "completed", "tag": "3c8c7d04-4fcc-498a-b858-122cea028627"}, {"server_uuid": "80bd1dd9-b80e-4533-98d5-0ca798bc4be9", "name": "network-vif-deleted", "tag": "3c8c7d04-4fcc-498a-b858-122cea028627"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-d7b3a150-6c8d-457d-8210-1b96dac8754b req-e8921637-0381-4a3a-bb11-6bf4668f612a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-d7b3a150-6c8d-457d-8210-1b96dac8754b req-e8921637-0381-4a3a-bb11-6bf4668f612a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-d7b3a150-6c8d-457d-8210-1b96dac8754b req-e8921637-0381-4a3a-bb11-6bf4668f612a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:07 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-d7b3a150-6c8d-457d-8210-1b96dac8754b req-e8921637-0381-4a3a-bb11-6bf4668f612a service nova] Creating event network-vif-plugged:3c8c7d04-4fcc-498a-b858-122cea028627 for instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 on user Apr 14 17:06:07 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-d7b3a150-6c8d-457d-8210-1b96dac8754b req-e8921637-0381-4a3a-bb11-6bf4668f612a service nova] Creating event network-vif-deleted:3c8c7d04-4fcc-498a-b858-122cea028627 for instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 on user Apr 14 17:06:07 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-d7b3a150-6c8d-457d-8210-1b96dac8754b req-e8921637-0381-4a3a-bb11-6bf4668f612a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032017 Apr 14 17:06:07 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 59/176] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:06:07 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:09 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:09 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:09 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-80eed5af-6ede-4acb-b162-b963896fef98 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173/os-interface/01bf74ae-32c2-4241-9a37-abba15fe3de6" status: 202 len: 0 microversion: 2.49 time: 0.066262 Apr 14 17:06:09 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 57/177] 10.0.0.210 () {64 vars in 1507 bytes} [Fri Apr 14 17:06:09 2023] DELETE /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173/os-interface/01bf74ae-32c2-4241-9a37-abba15fe3de6 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:06:10 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-7cbf7371-5ebe-4f85-8043-17f2fa46b6ee tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:10 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-7cbf7371-5ebe-4f85-8043-17f2fa46b6ee tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7cbf7371-5ebe-4f85-8043-17f2fa46b6ee tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7cbf7371-5ebe-4f85-8043-17f2fa46b6ee tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7cbf7371-5ebe-4f85-8043-17f2fa46b6ee tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7cbf7371-5ebe-4f85-8043-17f2fa46b6ee tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7cbf7371-5ebe-4f85-8043-17f2fa46b6ee tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7cbf7371-5ebe-4f85-8043-17f2fa46b6ee tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:10 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-7cbf7371-5ebe-4f85-8043-17f2fa46b6ee tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173/os-instance-actions/req-80eed5af-6ede-4acb-b162-b963896fef98" status: 200 len: 474 microversion: 2.49 time: 0.278047 Apr 14 17:06:10 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 62/178] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 17:06:09 2023] GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173/os-instance-actions/req-80eed5af-6ede-4acb-b162-b963896fef98 => generated 474 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 17:06:10 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-1e264a9c-5be2-44b4-967f-4cbc00201e25 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:10 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-1e264a9c-5be2-44b4-967f-4cbc00201e25 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1e264a9c-5be2-44b4-967f-4cbc00201e25 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1e264a9c-5be2-44b4-967f-4cbc00201e25 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1e264a9c-5be2-44b4-967f-4cbc00201e25 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1e264a9c-5be2-44b4-967f-4cbc00201e25 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1e264a9c-5be2-44b4-967f-4cbc00201e25 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1e264a9c-5be2-44b4-967f-4cbc00201e25 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:10 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-899b83d0-89e7-44fa-bb87-b7d1b22f3172 req-50d28a0a-3498-401e-8c77-aa1b6d340a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113dda5c-a61e-423b-86ea-2fe30a113173", "name": "network-vif-unplugged", "status": "completed", "tag": "01bf74ae-32c2-4241-9a37-abba15fe3de6"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-899b83d0-89e7-44fa-bb87-b7d1b22f3172 req-50d28a0a-3498-401e-8c77-aa1b6d340a02 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-899b83d0-89e7-44fa-bb87-b7d1b22f3172 req-50d28a0a-3498-401e-8c77-aa1b6d340a02 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-899b83d0-89e7-44fa-bb87-b7d1b22f3172 req-50d28a0a-3498-401e-8c77-aa1b6d340a02 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:10 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-899b83d0-89e7-44fa-bb87-b7d1b22f3172 req-50d28a0a-3498-401e-8c77-aa1b6d340a02 service nova] Creating event network-vif-unplugged:01bf74ae-32c2-4241-9a37-abba15fe3de6 for instance 113dda5c-a61e-423b-86ea-2fe30a113173 on user Apr 14 17:06:10 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-899b83d0-89e7-44fa-bb87-b7d1b22f3172 req-50d28a0a-3498-401e-8c77-aa1b6d340a02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047744 Apr 14 17:06:10 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 58/179] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:06:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:11 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-1e264a9c-5be2-44b4-967f-4cbc00201e25 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1ea0218b044c1e94f61a07c1d14a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426156fb00db428683851cf731b680d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:06:11 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-1e264a9c-5be2-44b4-967f-4cbc00201e25 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7465a41f-c916-4cca-8084-7c646409007d" status: 200 len: 1493 microversion: 2.1 time: 0.956644 Apr 14 17:06:11 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 60/180] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:06:10 2023] GET /compute/v2.1/servers/7465a41f-c916-4cca-8084-7c646409007d => generated 1493 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:06:11 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113dda5c-a61e-423b-86ea-2fe30a113173", "name": "network-vif-deleted", "tag": "01bf74ae-32c2-4241-9a37-abba15fe3de6"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:11 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:11 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:11 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:11 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] Creating event network-vif-deleted:01bf74ae-32c2-4241-9a37-abba15fe3de6 for instance 113dda5c-a61e-423b-86ea-2fe30a113173 on user Apr 14 17:06:11 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-974e21d5-61be-452d-a57c-ae86f1eff0ae req-ece04ad2-705b-4c3a-98ce-a26a0ed3d016 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084715 Apr 14 17:06:11 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 63/181] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:06:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:12 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-9135f406-fa86-4871-b470-f2f686eaa9f7 req-14848393-4674-4414-98ee-5a48e572d508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113dda5c-a61e-423b-86ea-2fe30a113173", "name": "network-vif-plugged", "status": "completed", "tag": "01bf74ae-32c2-4241-9a37-abba15fe3de6"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-9135f406-fa86-4871-b470-f2f686eaa9f7 req-14848393-4674-4414-98ee-5a48e572d508 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-9135f406-fa86-4871-b470-f2f686eaa9f7 req-14848393-4674-4414-98ee-5a48e572d508 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-9135f406-fa86-4871-b470-f2f686eaa9f7 req-14848393-4674-4414-98ee-5a48e572d508 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:12 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-9135f406-fa86-4871-b470-f2f686eaa9f7 req-14848393-4674-4414-98ee-5a48e572d508 service nova] Creating event network-vif-plugged:01bf74ae-32c2-4241-9a37-abba15fe3de6 for instance 113dda5c-a61e-423b-86ea-2fe30a113173 on user Apr 14 17:06:12 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-9135f406-fa86-4871-b470-f2f686eaa9f7 req-14848393-4674-4414-98ee-5a48e572d508 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027781 Apr 14 17:06:12 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 59/182] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:06:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:14 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-9b429640-7baa-484d-913a-3d1c0e6cb5c3 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:14 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-9b429640-7baa-484d-913a-3d1c0e6cb5c3 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9b429640-7baa-484d-913a-3d1c0e6cb5c3 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9b429640-7baa-484d-913a-3d1c0e6cb5c3 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9b429640-7baa-484d-913a-3d1c0e6cb5c3 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9b429640-7baa-484d-913a-3d1c0e6cb5c3 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9b429640-7baa-484d-913a-3d1c0e6cb5c3 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9b429640-7baa-484d-913a-3d1c0e6cb5c3 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:14 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-9b429640-7baa-484d-913a-3d1c0e6cb5c3 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042632 Apr 14 17:06:14 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 61/183] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:06:14 2023] GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:14 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-c4d57a7d-2d99-4ab0-a910-367cd6c2ae5a tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:14 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-c4d57a7d-2d99-4ab0-a910-367cd6c2ae5a tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c4d57a7d-2d99-4ab0-a910-367cd6c2ae5a tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c4d57a7d-2d99-4ab0-a910-367cd6c2ae5a tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c4d57a7d-2d99-4ab0-a910-367cd6c2ae5a tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c4d57a7d-2d99-4ab0-a910-367cd6c2ae5a tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c4d57a7d-2d99-4ab0-a910-367cd6c2ae5a tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c4d57a7d-2d99-4ab0-a910-367cd6c2ae5a tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:14 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-c4d57a7d-2d99-4ab0-a910-367cd6c2ae5a tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046128 Apr 14 17:06:14 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 64/184] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:06:14 2023] GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:14 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "3efe6a50-62c4-4eae-a012-2d4a71faa73f"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:14 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:15 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-26ab902e-61b6-43e1-bcfb-d547b44d490e tempest-TestVolumeSwap-862265959 tempest-TestVolumeSwap-862265959-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments/fa07d38e-7ab2-4439-b17f-e6a139923ab3" status: 202 len: 0 microversion: 2.1 time: 0.281706 Apr 14 17:06:15 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 60/185] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 17:06:14 2023] PUT /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments/fa07d38e-7ab2-4439-b17f-e6a139923ab3 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:06:21 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-89727691-4c32-4a79-a087-0991d9aff5c2 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:21 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-89727691-4c32-4a79-a087-0991d9aff5c2 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:21 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=22 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:06:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-89727691-4c32-4a79-a087-0991d9aff5c2 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-89727691-4c32-4a79-a087-0991d9aff5c2 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-89727691-4c32-4a79-a087-0991d9aff5c2 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-89727691-4c32-4a79-a087-0991d9aff5c2 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-89727691-4c32-4a79-a087-0991d9aff5c2 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-89727691-4c32-4a79-a087-0991d9aff5c2 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:21 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:06:22 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-89727691-4c32-4a79-a087-0991d9aff5c2 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.422223 Apr 14 17:06:22 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 62/186] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 17:06:21 2023] GET /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58/os-interface => generated 1830 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:06:23 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-48d36650-c0da-4398-bc01-40a7d33180db req-e7980b97-7559-4a3f-9efb-1d0814e7ce86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "tag": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:23 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:06:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-48d36650-c0da-4398-bc01-40a7d33180db req-e7980b97-7559-4a3f-9efb-1d0814e7ce86 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-48d36650-c0da-4398-bc01-40a7d33180db req-e7980b97-7559-4a3f-9efb-1d0814e7ce86 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-48d36650-c0da-4398-bc01-40a7d33180db req-e7980b97-7559-4a3f-9efb-1d0814e7ce86 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:23 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=6,nova_cell1:INSERT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:06:23 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-48d36650-c0da-4398-bc01-40a7d33180db req-e7980b97-7559-4a3f-9efb-1d0814e7ce86 service nova] Creating event network-changed:908df516-5b0a-42b8-82d4-1f36c0dbcdc0 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:23 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-48d36650-c0da-4398-bc01-40a7d33180db req-e7980b97-7559-4a3f-9efb-1d0814e7ce86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047350 Apr 14 17:06:23 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 65/187] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:06:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-22a9d2f2-52d6-4d5d-b3eb-0b0056104562 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-22a9d2f2-52d6-4d5d-b3eb-0b0056104562 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-22a9d2f2-52d6-4d5d-b3eb-0b0056104562 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-22a9d2f2-52d6-4d5d-b3eb-0b0056104562 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-22a9d2f2-52d6-4d5d-b3eb-0b0056104562 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-22a9d2f2-52d6-4d5d-b3eb-0b0056104562 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-22a9d2f2-52d6-4d5d-b3eb-0b0056104562 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-22a9d2f2-52d6-4d5d-b3eb-0b0056104562 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-22a9d2f2-52d6-4d5d-b3eb-0b0056104562 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029c39b7ada54f7b9cb106f054ec8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0706fb42134445cf914a9a00b1042c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:06:23 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-17a97339-83c5-469a-a9ac-0be16031c1bc tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:23 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-17a97339-83c5-469a-a9ac-0be16031c1bc tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-22a9d2f2-52d6-4d5d-b3eb-0b0056104562 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '029c39b7ada54f7b9cb106f054ec8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0706fb42134445cf914a9a00b1042c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:06:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-17a97339-83c5-469a-a9ac-0be16031c1bc tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-17a97339-83c5-469a-a9ac-0be16031c1bc tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-22a9d2f2-52d6-4d5d-b3eb-0b0056104562 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '029c39b7ada54f7b9cb106f054ec8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0706fb42134445cf914a9a00b1042c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:06:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-17a97339-83c5-469a-a9ac-0be16031c1bc tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-17a97339-83c5-469a-a9ac-0be16031c1bc tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-17a97339-83c5-469a-a9ac-0be16031c1bc tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:23 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-22a9d2f2-52d6-4d5d-b3eb-0b0056104562 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58" status: 200 len: 2822 microversion: 2.32 time: 0.506877 Apr 14 17:06:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-17a97339-83c5-469a-a9ac-0be16031c1bc tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:23 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 61/188] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:06:23 2023] GET /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58 => generated 2822 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:06:23 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-17a97339-83c5-469a-a9ac-0be16031c1bc tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] HTTP exception thrown: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:23 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-be955357-74cc-42af-9a04-ee2b24a8b9da tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:23 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-be955357-74cc-42af-9a04-ee2b24a8b9da tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:23 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-17a97339-83c5-469a-a9ac-0be16031c1bc tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Request method failure captured: Apr 14 17:06:23 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e HTTP/1.1 Apr 14 17:06:23 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:06:23 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:06:23 user devstack@n-api.service[61933]: Connection: close Apr 14 17:06:23 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:06:23 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:06:23 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:06:23 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:06:23 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:06:23 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYdhnVAlbvZrgjZHgB7vYf9XekKMuk-uS7ME8pH8T1PtgB7NyY7HRTm3HdBPk1_NM-5npxVewDphSAlqzqyER-an8pt_n4Fe2CcUrjZbd6z8DE6GlUK0fa1mcwQEJldbJqofkmEpERK3_KAjylnMKHmgWXgq61T7I7SgX5FUtI_4eyY Apr 14 17:06:23 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:06:23 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:06:23 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:06:23 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:06:23 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:06:23 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:06:23 user devstack@n-api.service[61933]: X-Project-Id: 762a37326f89466c9ee3714ea2e2e905 Apr 14 17:06:23 user devstack@n-api.service[61933]: X-Project-Name: tempest-DeleteServersTestJSON-1540294942 Apr 14 17:06:23 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:06:23 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:06:23 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/762a37326f89466c9ee3714ea2e2e905"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/762a37326f89466c9ee3714ea2e2e905"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/762a37326f89466c9ee3714ea2e2e905"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:06:23 user devstack@n-api.service[61933]: X-Tenant: tempest-DeleteServersTestJSON-1540294942 Apr 14 17:06:23 user devstack@n-api.service[61933]: X-Tenant-Id: 762a37326f89466c9ee3714ea2e2e905 Apr 14 17:06:23 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-DeleteServersTestJSON-1540294942 Apr 14 17:06:23 user devstack@n-api.service[61933]: X-User: tempest-DeleteServersTestJSON-1540294942-project-member Apr 14 17:06:23 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:06:23 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:06:23 user devstack@n-api.service[61933]: X-User-Id: 740d636ab92c4700b480ea58ce6a30ff Apr 14 17:06:23 user devstack@n-api.service[61933]: X-User-Name: tempest-DeleteServersTestJSON-1540294942-project-member Apr 14 17:06:23 user devstack@n-api.service[61933]: method: > Apr 14 17:06:23 user devstack@n-api.service[61933]: exception: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:23 user devstack@n-api.service[61933]: action_args: {'id': '6e707b44-e838-4494-9fbc-5698e755e09e'} Apr 14 17:06:23 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:06:23 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-17a97339-83c5-469a-a9ac-0be16031c1bc tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Returning 404 to user: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:06:23 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-17a97339-83c5-469a-a9ac-0be16031c1bc tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e" status: 404 len: 111 microversion: 2.1 time: 0.059937 Apr 14 17:06:23 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 63/189] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:06:23 2023] GET /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:06:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-be955357-74cc-42af-9a04-ee2b24a8b9da tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-be955357-74cc-42af-9a04-ee2b24a8b9da tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-be955357-74cc-42af-9a04-ee2b24a8b9da tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-be955357-74cc-42af-9a04-ee2b24a8b9da tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-be955357-74cc-42af-9a04-ee2b24a8b9da tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-be955357-74cc-42af-9a04-ee2b24a8b9da tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-3cb472cb-84a3-472f-860a-9736e4171b7f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-3cb472cb-84a3-472f-860a-9736e4171b7f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3cb472cb-84a3-472f-860a-9736e4171b7f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3cb472cb-84a3-472f-860a-9736e4171b7f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3cb472cb-84a3-472f-860a-9736e4171b7f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3cb472cb-84a3-472f-860a-9736e4171b7f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3cb472cb-84a3-472f-860a-9736e4171b7f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3cb472cb-84a3-472f-860a-9736e4171b7f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:23 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-3cb472cb-84a3-472f-860a-9736e4171b7f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] HTTP exception thrown: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:23 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-be955357-74cc-42af-9a04-ee2b24a8b9da tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.213217 Apr 14 17:06:23 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 66/190] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 17:06:23 2023] GET /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58/os-interface => generated 1830 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-3cb472cb-84a3-472f-860a-9736e4171b7f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Request method failure captured: Apr 14 17:06:23 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e/os-volume_attachments HTTP/1.1 Apr 14 17:06:23 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:06:23 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:06:23 user devstack@n-api.service[61934]: Connection: close Apr 14 17:06:23 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:06:23 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:06:23 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:06:23 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:06:23 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:06:23 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYdhnVAlbvZrgjZHgB7vYf9XekKMuk-uS7ME8pH8T1PtgB7NyY7HRTm3HdBPk1_NM-5npxVewDphSAlqzqyER-an8pt_n4Fe2CcUrjZbd6z8DE6GlUK0fa1mcwQEJldbJqofkmEpERK3_KAjylnMKHmgWXgq61T7I7SgX5FUtI_4eyY Apr 14 17:06:23 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:06:23 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:06:23 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:06:23 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:06:23 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:06:23 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:06:23 user devstack@n-api.service[61934]: X-Project-Id: 762a37326f89466c9ee3714ea2e2e905 Apr 14 17:06:23 user devstack@n-api.service[61934]: X-Project-Name: tempest-DeleteServersTestJSON-1540294942 Apr 14 17:06:23 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:06:23 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:06:23 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/762a37326f89466c9ee3714ea2e2e905"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/762a37326f89466c9ee3714ea2e2e905"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/762a37326f89466c9ee3714ea2e2e905"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:06:23 user devstack@n-api.service[61934]: X-Tenant: tempest-DeleteServersTestJSON-1540294942 Apr 14 17:06:23 user devstack@n-api.service[61934]: X-Tenant-Id: 762a37326f89466c9ee3714ea2e2e905 Apr 14 17:06:23 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-DeleteServersTestJSON-1540294942 Apr 14 17:06:23 user devstack@n-api.service[61934]: X-User: tempest-DeleteServersTestJSON-1540294942-project-member Apr 14 17:06:23 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:06:23 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:06:23 user devstack@n-api.service[61934]: X-User-Id: 740d636ab92c4700b480ea58ce6a30ff Apr 14 17:06:23 user devstack@n-api.service[61934]: X-User-Name: tempest-DeleteServersTestJSON-1540294942-project-member Apr 14 17:06:23 user devstack@n-api.service[61934]: method: > Apr 14 17:06:23 user devstack@n-api.service[61934]: exception: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:23 user devstack@n-api.service[61934]: action_args: {'server_id': '6e707b44-e838-4494-9fbc-5698e755e09e'} Apr 14 17:06:23 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:23 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:06:23 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-3cb472cb-84a3-472f-860a-9736e4171b7f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Returning 404 to user: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:06:23 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-3cb472cb-84a3-472f-860a-9736e4171b7f tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042129 Apr 14 17:06:23 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 62/191] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:06:23 2023] GET /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:06:24 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-fada4357-05b6-4134-8666-f7b789f0405b tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '.version_select at 0x7fe19d1337f0>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:24 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-fada4357-05b6-4134-8666-f7b789f0405b tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "GET /compute/v2.1/images/76d1cc2c-f73e-47b3-a798-4adb640ecdc8" status: 200 len: 1723 microversion: 2.1 time: 0.091580 Apr 14 17:06:24 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 64/192] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 17:06:24 2023] GET /compute/v2.1/images/76d1cc2c-f73e-47b3-a798-4adb640ecdc8 => generated 1723 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:06:24 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-9ad6144d-6279-44ae-92f2-7a20791e3495 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '.version_select at 0x7fe19d1cf5b0>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:24 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-9ad6144d-6279-44ae-92f2-7a20791e3495 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "GET /compute/v2.1/images/76d1cc2c-f73e-47b3-a798-4adb640ecdc8" status: 200 len: 1723 microversion: 2.1 time: 0.087998 Apr 14 17:06:24 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 67/193] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 17:06:24 2023] GET /compute/v2.1/images/76d1cc2c-f73e-47b3-a798-4adb640ecdc8 => generated 1723 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:06:24 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-376cf506-32d0-4653-b292-54031ec30107 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:24 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-376cf506-32d0-4653-b292-54031ec30107 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:24 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-376cf506-32d0-4653-b292-54031ec30107 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:24 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-376cf506-32d0-4653-b292-54031ec30107 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:24 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-376cf506-32d0-4653-b292-54031ec30107 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:24 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-376cf506-32d0-4653-b292-54031ec30107 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:24 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-376cf506-32d0-4653-b292-54031ec30107 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:24 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-376cf506-32d0-4653-b292-54031ec30107 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:25 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-376cf506-32d0-4653-b292-54031ec30107 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d67df67ba8e4905bf7c6545c5748a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2764eee6c4071b5607f78762ca653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:06:25 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:06:25 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-376cf506-32d0-4653-b292-54031ec30107 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd" status: 200 len: 1672 microversion: 2.1 time: 0.724998 Apr 14 17:06:25 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 63/194] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:06:24 2023] GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd => generated 1672 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 17:06:25 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:25 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:25 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:25 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:25 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:25 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:25 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:25 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:25 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Going to try to terminate instance {{(pid=61933) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:06:25 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-cd50e1cc-da97-44e9-a17c-6ebd3b1e1394 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58" status: 204 len: 0 microversion: 2.32 time: 0.189183 Apr 14 17:06:25 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 65/195] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 17:06:25 2023] DELETE /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 17:06:25 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a859db13-1de3-4549-8c2f-4a6834f9d0f1 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:25 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-a859db13-1de3-4549-8c2f-4a6834f9d0f1 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a859db13-1de3-4549-8c2f-4a6834f9d0f1 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a859db13-1de3-4549-8c2f-4a6834f9d0f1 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a859db13-1de3-4549-8c2f-4a6834f9d0f1 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a859db13-1de3-4549-8c2f-4a6834f9d0f1 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a859db13-1de3-4549-8c2f-4a6834f9d0f1 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a859db13-1de3-4549-8c2f-4a6834f9d0f1 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:25 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-a859db13-1de3-4549-8c2f-4a6834f9d0f1 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029c39b7ada54f7b9cb106f054ec8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0706fb42134445cf914a9a00b1042c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:06:25 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-a859db13-1de3-4549-8c2f-4a6834f9d0f1 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '029c39b7ada54f7b9cb106f054ec8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0706fb42134445cf914a9a00b1042c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:06:25 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-a859db13-1de3-4549-8c2f-4a6834f9d0f1 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '029c39b7ada54f7b9cb106f054ec8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0706fb42134445cf914a9a00b1042c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:06:25 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-a859db13-1de3-4549-8c2f-4a6834f9d0f1 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58" status: 200 len: 2947 microversion: 2.32 time: 0.242229 Apr 14 17:06:25 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 68/196] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:06:25 2023] GET /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58 => generated 2947 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:06:25 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-2fded9b8-4973-4f1c-b1c7-ba211b5df12d req-c2fc2c01-79bd-4a1b-85d7-cc5ee48ea695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-unplugged", "status": "completed", "tag": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:25 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=28 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:06:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-2fded9b8-4973-4f1c-b1c7-ba211b5df12d req-c2fc2c01-79bd-4a1b-85d7-cc5ee48ea695 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-2fded9b8-4973-4f1c-b1c7-ba211b5df12d req-c2fc2c01-79bd-4a1b-85d7-cc5ee48ea695 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-2fded9b8-4973-4f1c-b1c7-ba211b5df12d req-c2fc2c01-79bd-4a1b-85d7-cc5ee48ea695 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:25 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-2fded9b8-4973-4f1c-b1c7-ba211b5df12d req-c2fc2c01-79bd-4a1b-85d7-cc5ee48ea695 service nova] Creating event network-vif-unplugged:908df516-5b0a-42b8-82d4-1f36c0dbcdc0 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:25 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-2fded9b8-4973-4f1c-b1c7-ba211b5df12d req-c2fc2c01-79bd-4a1b-85d7-cc5ee48ea695 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036465 Apr 14 17:06:25 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 64/197] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:06:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:25 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-7ccedb6d-ed84-4c66-b6f3-d22c34c1d315 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:25 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-7ccedb6d-ed84-4c66-b6f3-d22c34c1d315 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:25 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7ccedb6d-ed84-4c66-b6f3-d22c34c1d315 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:25 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7ccedb6d-ed84-4c66-b6f3-d22c34c1d315 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:25 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7ccedb6d-ed84-4c66-b6f3-d22c34c1d315 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:25 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7ccedb6d-ed84-4c66-b6f3-d22c34c1d315 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:25 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7ccedb6d-ed84-4c66-b6f3-d22c34c1d315 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:25 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7ccedb6d-ed84-4c66-b6f3-d22c34c1d315 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:25 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-f4c71d6b-b420-4f4a-aa1b-70a381820325 req-5fb4405f-fc03-4431-bee9-56732b42b3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-unplugged", "status": "completed", "tag": "f7320798-2ab9-411c-98dd-2f0006b0c3e2"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-f4c71d6b-b420-4f4a-aa1b-70a381820325 req-5fb4405f-fc03-4431-bee9-56732b42b3c2 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-f4c71d6b-b420-4f4a-aa1b-70a381820325 req-5fb4405f-fc03-4431-bee9-56732b42b3c2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-f4c71d6b-b420-4f4a-aa1b-70a381820325 req-5fb4405f-fc03-4431-bee9-56732b42b3c2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:25 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-f4c71d6b-b420-4f4a-aa1b-70a381820325 req-5fb4405f-fc03-4431-bee9-56732b42b3c2 service nova] Creating event network-vif-unplugged:f7320798-2ab9-411c-98dd-2f0006b0c3e2 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:25 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-f4c71d6b-b420-4f4a-aa1b-70a381820325 req-5fb4405f-fc03-4431-bee9-56732b42b3c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051013 Apr 14 17:06:25 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 69/198] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:06:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 17:06:26 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-7ccedb6d-ed84-4c66-b6f3-d22c34c1d315 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c4734925f645248b0f9060aa78a502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8f6b39515e456c9f5a1affa9f79000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:06:26 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-7ccedb6d-ed84-4c66-b6f3-d22c34c1d315 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97" status: 200 len: 1687 microversion: 2.1 time: 0.611393 Apr 14 17:06:26 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 66/199] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:06:25 2023] GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97 => generated 1687 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:06:27 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-unplugged", "status": "completed", "tag": "d61ec716-2b00-4426-b014-fb1d07515463"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "d61ec716-2b00-4426-b014-fb1d07515463"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-unplugged", "status": "completed", "tag": "3b216986-dcbd-4502-8655-92a598ad85db"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "3b216986-dcbd-4502-8655-92a598ad85db"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-unplugged", "status": "completed", "tag": "c33eac6d-3cd4-491c-b151-abeb733a0a09"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "c33eac6d-3cd4-491c-b151-abeb733a0a09"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:27 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Creating event network-vif-plugged:908df516-5b0a-42b8-82d4-1f36c0dbcdc0 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:27 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Creating event network-vif-unplugged:d61ec716-2b00-4426-b014-fb1d07515463 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:27 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Creating event network-vif-plugged:d61ec716-2b00-4426-b014-fb1d07515463 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:27 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Creating event network-vif-unplugged:3b216986-dcbd-4502-8655-92a598ad85db for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:27 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Creating event network-vif-plugged:3b216986-dcbd-4502-8655-92a598ad85db for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:27 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Creating event network-vif-unplugged:c33eac6d-3cd4-491c-b151-abeb733a0a09 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:27 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] Creating event network-vif-plugged:c33eac6d-3cd4-491c-b151-abeb733a0a09 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:27 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-ab992bf8-f036-451f-974b-a5bdae0d1b8d req-963d07ac-fa2e-4655-a302-e7096cc276b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.040298 Apr 14 17:06:27 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 65/200] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 17:06:27 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:06:27 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "f7320798-2ab9-411c-98dd-2f0006b0c3e2"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-unplugged", "status": "completed", "tag": "b14ce4b0-a632-4f21-b582-8aef000caf49"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "b14ce4b0-a632-4f21-b582-8aef000caf49"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:27 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:27 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:27 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:27 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] Creating event network-vif-plugged:f7320798-2ab9-411c-98dd-2f0006b0c3e2 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:27 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] Creating event network-vif-unplugged:b14ce4b0-a632-4f21-b582-8aef000caf49 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:27 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] Creating event network-vif-plugged:b14ce4b0-a632-4f21-b582-8aef000caf49 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:28 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-8aae17bf-b835-48c8-b410-89636156a5fa req-bdbe4259-889e-4d86-a8c7-52ba79793f90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.037433 Apr 14 17:06:28 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 70/201] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:06:27 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-072f0be2-7e07-4975-8e4d-54d6c45b57ab tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-072f0be2-7e07-4975-8e4d-54d6c45b57ab tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-072f0be2-7e07-4975-8e4d-54d6c45b57ab tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-072f0be2-7e07-4975-8e4d-54d6c45b57ab tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-072f0be2-7e07-4975-8e4d-54d6c45b57ab tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-072f0be2-7e07-4975-8e4d-54d6c45b57ab tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-072f0be2-7e07-4975-8e4d-54d6c45b57ab tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-072f0be2-7e07-4975-8e4d-54d6c45b57ab tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:28 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-072f0be2-7e07-4975-8e4d-54d6c45b57ab tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046951 Apr 14 17:06:28 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 67/202] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:06:28 2023] GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:28 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-40d737fe-30ef-44a9-a9a4-05c8674a7b3d tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:28 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-40d737fe-30ef-44a9-a9a4-05c8674a7b3d tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-40d737fe-30ef-44a9-a9a4-05c8674a7b3d tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-40d737fe-30ef-44a9-a9a4-05c8674a7b3d tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-40d737fe-30ef-44a9-a9a4-05c8674a7b3d tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-40d737fe-30ef-44a9-a9a4-05c8674a7b3d tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-40d737fe-30ef-44a9-a9a4-05c8674a7b3d tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-40d737fe-30ef-44a9-a9a4-05c8674a7b3d tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:28 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-40d737fe-30ef-44a9-a9a4-05c8674a7b3d tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045802 Apr 14 17:06:28 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 66/203] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:06:28 2023] GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:28 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:28 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:28 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:28 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:28 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:28 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:28 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:28 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d6f58df3-25a9-4b31-a337-e3d1aafd8c6c tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-d6f58df3-25a9-4b31-a337-e3d1aafd8c6c tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6f58df3-25a9-4b31-a337-e3d1aafd8c6c tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6f58df3-25a9-4b31-a337-e3d1aafd8c6c tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6f58df3-25a9-4b31-a337-e3d1aafd8c6c tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6f58df3-25a9-4b31-a337-e3d1aafd8c6c tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6f58df3-25a9-4b31-a337-e3d1aafd8c6c tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6f58df3-25a9-4b31-a337-e3d1aafd8c6c tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:28 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-d6f58df3-25a9-4b31-a337-e3d1aafd8c6c tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] HTTP exception thrown: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d6f58df3-25a9-4b31-a337-e3d1aafd8c6c tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Request method failure captured: Apr 14 17:06:28 user devstack@n-api.service[61933]: request: DELETE /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e HTTP/1.1 Apr 14 17:06:28 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:06:28 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:06:28 user devstack@n-api.service[61933]: Connection: close Apr 14 17:06:28 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:06:28 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:06:28 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:06:28 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:06:28 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:06:28 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYdhnVAlbvZrgjZHgB7vYf9XekKMuk-uS7ME8pH8T1PtgB7NyY7HRTm3HdBPk1_NM-5npxVewDphSAlqzqyER-an8pt_n4Fe2CcUrjZbd6z8DE6GlUK0fa1mcwQEJldbJqofkmEpERK3_KAjylnMKHmgWXgq61T7I7SgX5FUtI_4eyY Apr 14 17:06:28 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:06:28 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:06:28 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:06:28 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:06:28 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:06:28 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:06:28 user devstack@n-api.service[61933]: X-Project-Id: 762a37326f89466c9ee3714ea2e2e905 Apr 14 17:06:28 user devstack@n-api.service[61933]: X-Project-Name: tempest-DeleteServersTestJSON-1540294942 Apr 14 17:06:28 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:06:28 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:06:28 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/762a37326f89466c9ee3714ea2e2e905"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/762a37326f89466c9ee3714ea2e2e905"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/762a37326f89466c9ee3714ea2e2e905"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:06:28 user devstack@n-api.service[61933]: X-Tenant: tempest-DeleteServersTestJSON-1540294942 Apr 14 17:06:28 user devstack@n-api.service[61933]: X-Tenant-Id: 762a37326f89466c9ee3714ea2e2e905 Apr 14 17:06:28 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-DeleteServersTestJSON-1540294942 Apr 14 17:06:28 user devstack@n-api.service[61933]: X-User: tempest-DeleteServersTestJSON-1540294942-project-member Apr 14 17:06:28 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:06:28 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:06:28 user devstack@n-api.service[61933]: X-User-Id: 740d636ab92c4700b480ea58ce6a30ff Apr 14 17:06:28 user devstack@n-api.service[61933]: X-User-Name: tempest-DeleteServersTestJSON-1540294942-project-member Apr 14 17:06:28 user devstack@n-api.service[61933]: method: > Apr 14 17:06:28 user devstack@n-api.service[61933]: exception: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:28 user devstack@n-api.service[61933]: action_args: {'id': '6e707b44-e838-4494-9fbc-5698e755e09e'} Apr 14 17:06:28 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:28 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d6f58df3-25a9-4b31-a337-e3d1aafd8c6c tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Returning 404 to user: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:06:28 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d6f58df3-25a9-4b31-a337-e3d1aafd8c6c tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e" status: 404 len: 111 microversion: 2.1 time: 0.031985 Apr 14 17:06:28 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 68/204] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:06:28 2023] DELETE /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:06:28 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-1db643fa-990e-4113-bc2f-479ac95530dd tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:28 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-1db643fa-990e-4113-bc2f-479ac95530dd tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] [instance: 6e707b44-e838-4494-9fbc-5698e755e09e] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1db643fa-990e-4113-bc2f-479ac95530dd tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1db643fa-990e-4113-bc2f-479ac95530dd tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1db643fa-990e-4113-bc2f-479ac95530dd tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1db643fa-990e-4113-bc2f-479ac95530dd tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1db643fa-990e-4113-bc2f-479ac95530dd tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1db643fa-990e-4113-bc2f-479ac95530dd tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:28 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-1db643fa-990e-4113-bc2f-479ac95530dd tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] HTTP exception thrown: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:28 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-1db643fa-990e-4113-bc2f-479ac95530dd tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Request method failure captured: Apr 14 17:06:28 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e HTTP/1.1 Apr 14 17:06:28 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:06:28 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:06:28 user devstack@n-api.service[61934]: Connection: close Apr 14 17:06:28 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:06:28 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:06:28 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:06:28 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:06:28 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:06:28 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYdhnVAlbvZrgjZHgB7vYf9XekKMuk-uS7ME8pH8T1PtgB7NyY7HRTm3HdBPk1_NM-5npxVewDphSAlqzqyER-an8pt_n4Fe2CcUrjZbd6z8DE6GlUK0fa1mcwQEJldbJqofkmEpERK3_KAjylnMKHmgWXgq61T7I7SgX5FUtI_4eyY Apr 14 17:06:28 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:06:28 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:06:28 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:06:28 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:06:28 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:06:28 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:06:28 user devstack@n-api.service[61934]: X-Project-Id: 762a37326f89466c9ee3714ea2e2e905 Apr 14 17:06:28 user devstack@n-api.service[61934]: X-Project-Name: tempest-DeleteServersTestJSON-1540294942 Apr 14 17:06:28 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:06:28 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:06:28 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/762a37326f89466c9ee3714ea2e2e905"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/762a37326f89466c9ee3714ea2e2e905"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/762a37326f89466c9ee3714ea2e2e905"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:06:28 user devstack@n-api.service[61934]: X-Tenant: tempest-DeleteServersTestJSON-1540294942 Apr 14 17:06:28 user devstack@n-api.service[61934]: X-Tenant-Id: 762a37326f89466c9ee3714ea2e2e905 Apr 14 17:06:28 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-DeleteServersTestJSON-1540294942 Apr 14 17:06:28 user devstack@n-api.service[61934]: X-User: tempest-DeleteServersTestJSON-1540294942-project-member Apr 14 17:06:28 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:06:28 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:06:28 user devstack@n-api.service[61934]: X-User-Id: 740d636ab92c4700b480ea58ce6a30ff Apr 14 17:06:28 user devstack@n-api.service[61934]: X-User-Name: tempest-DeleteServersTestJSON-1540294942-project-member Apr 14 17:06:28 user devstack@n-api.service[61934]: method: > Apr 14 17:06:28 user devstack@n-api.service[61934]: exception: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:28 user devstack@n-api.service[61934]: action_args: {'id': '6e707b44-e838-4494-9fbc-5698e755e09e'} Apr 14 17:06:28 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. Apr 14 17:06:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:06:28 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-1db643fa-990e-4113-bc2f-479ac95530dd tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] Returning 404 to user: Instance 6e707b44-e838-4494-9fbc-5698e755e09e could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:06:28 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-1db643fa-990e-4113-bc2f-479ac95530dd tempest-DeleteServersTestJSON-1540294942 tempest-DeleteServersTestJSON-1540294942-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e" status: 404 len: 111 microversion: 2.1 time: 0.029060 Apr 14 17:06:28 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 67/205] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:06:28 2023] GET /compute/v2.1/servers/6e707b44-e838-4494-9fbc-5698e755e09e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:06:28 user devstack@n-api.service[61935]: DEBUG nova.objects.instance [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lazy-loading 'services' on Instance uuid f53cfe1f-c915-4a74-8512-84a97147f1d1 {{(pid=61935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:06:28 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-a265c166-9b6f-48c6-a1ad-a574325c221f tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments/3efe6a50-62c4-4eae-a012-2d4a71faa73f" status: 202 len: 0 microversion: 2.1 time: 0.207322 Apr 14 17:06:28 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 71/206] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:06:28 2023] DELETE /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments/3efe6a50-62c4-4eae-a012-2d4a71faa73f => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-374ba6ce-a260-40b8-a63c-c2391464e78c tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-374ba6ce-a260-40b8-a63c-c2391464e78c tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-374ba6ce-a260-40b8-a63c-c2391464e78c tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-374ba6ce-a260-40b8-a63c-c2391464e78c tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-374ba6ce-a260-40b8-a63c-c2391464e78c tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-374ba6ce-a260-40b8-a63c-c2391464e78c tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-374ba6ce-a260-40b8-a63c-c2391464e78c tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-374ba6ce-a260-40b8-a63c-c2391464e78c tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:28 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-374ba6ce-a260-40b8-a63c-c2391464e78c tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052904 Apr 14 17:06:28 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 69/207] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:06:28 2023] GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:29 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-276b570b-8e82-49bd-b293-e94189f10476 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:29 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-276b570b-8e82-49bd-b293-e94189f10476 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-276b570b-8e82-49bd-b293-e94189f10476 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-276b570b-8e82-49bd-b293-e94189f10476 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-276b570b-8e82-49bd-b293-e94189f10476 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-276b570b-8e82-49bd-b293-e94189f10476 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-276b570b-8e82-49bd-b293-e94189f10476 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-276b570b-8e82-49bd-b293-e94189f10476 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:29 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-276b570b-8e82-49bd-b293-e94189f10476 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c9e0d318eb4ca49d47d620682fb00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f341a2096b9483787b569a59f325556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:06:29 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-276b570b-8e82-49bd-b293-e94189f10476 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd" status: 200 len: 1546 microversion: 2.1 time: 0.314917 Apr 14 17:06:29 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 68/208] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:06:29 2023] GET /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd => generated 1546 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:06:29 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-unplugged", "status": "completed", "tag": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-plugged", "status": "completed", "tag": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:29 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] Creating event network-vif-unplugged:da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:29 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] Creating event network-vif-plugged:da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:29 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-5fc2754b-9763-4b89-8e81-2cd7b5d025d9 req-cff27f45-99bf-4d13-9307-35420596fda2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030993 Apr 14 17:06:29 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 72/209] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:06:29 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:31 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-dc63f0a2-b94b-486f-b58b-45169fa81c6c req-bc0a8e4b-3131-4b72-9d0b-47630b51c8eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-deleted", "tag": "b14ce4b0-a632-4f21-b582-8aef000caf49"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-dc63f0a2-b94b-486f-b58b-45169fa81c6c req-bc0a8e4b-3131-4b72-9d0b-47630b51c8eb service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-dc63f0a2-b94b-486f-b58b-45169fa81c6c req-bc0a8e4b-3131-4b72-9d0b-47630b51c8eb service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-dc63f0a2-b94b-486f-b58b-45169fa81c6c req-bc0a8e4b-3131-4b72-9d0b-47630b51c8eb service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:31 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-dc63f0a2-b94b-486f-b58b-45169fa81c6c req-bc0a8e4b-3131-4b72-9d0b-47630b51c8eb service nova] Creating event network-vif-deleted:b14ce4b0-a632-4f21-b582-8aef000caf49 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:31 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-dc63f0a2-b94b-486f-b58b-45169fa81c6c req-bc0a8e4b-3131-4b72-9d0b-47630b51c8eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041979 Apr 14 17:06:31 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 70/210] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:06:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:33 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-66291f13-8af8-4549-b213-4af486e40ce4 req-ac4a7828-89dd-4743-8135-81735f43146f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-deleted", "tag": "908df516-5b0a-42b8-82d4-1f36c0dbcdc0"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-deleted", "tag": "3b216986-dcbd-4502-8655-92a598ad85db"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-deleted", "tag": "da304e0f-68cc-40fd-a4f9-1175ce2c3ad3"}, {"server_uuid": "d8483240-2bf3-42cd-bf10-5d8231303e58", "name": "network-vif-deleted", "tag": "c33eac6d-3cd4-491c-b151-abeb733a0a09"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-66291f13-8af8-4549-b213-4af486e40ce4 req-ac4a7828-89dd-4743-8135-81735f43146f service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-66291f13-8af8-4549-b213-4af486e40ce4 req-ac4a7828-89dd-4743-8135-81735f43146f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-66291f13-8af8-4549-b213-4af486e40ce4 req-ac4a7828-89dd-4743-8135-81735f43146f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:33 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-66291f13-8af8-4549-b213-4af486e40ce4 req-ac4a7828-89dd-4743-8135-81735f43146f service nova] Creating event network-vif-deleted:908df516-5b0a-42b8-82d4-1f36c0dbcdc0 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:33 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-66291f13-8af8-4549-b213-4af486e40ce4 req-ac4a7828-89dd-4743-8135-81735f43146f service nova] Creating event network-vif-deleted:3b216986-dcbd-4502-8655-92a598ad85db for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:33 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-66291f13-8af8-4549-b213-4af486e40ce4 req-ac4a7828-89dd-4743-8135-81735f43146f service nova] Creating event network-vif-deleted:da304e0f-68cc-40fd-a4f9-1175ce2c3ad3 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:33 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-66291f13-8af8-4549-b213-4af486e40ce4 req-ac4a7828-89dd-4743-8135-81735f43146f service nova] Creating event network-vif-deleted:c33eac6d-3cd4-491c-b151-abeb733a0a09 for instance d8483240-2bf3-42cd-bf10-5d8231303e58 on user Apr 14 17:06:33 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-66291f13-8af8-4549-b213-4af486e40ce4 req-ac4a7828-89dd-4743-8135-81735f43146f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.042518 Apr 14 17:06:33 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 69/211] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:06:33 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:45 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=13 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:06:45 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:06:45 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-98da0f6a-04f0-4b76-8e9b-230ce6b324fa tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:45 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-98da0f6a-04f0-4b76-8e9b-230ce6b324fa tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-98da0f6a-04f0-4b76-8e9b-230ce6b324fa tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-98da0f6a-04f0-4b76-8e9b-230ce6b324fa tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-98da0f6a-04f0-4b76-8e9b-230ce6b324fa tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-98da0f6a-04f0-4b76-8e9b-230ce6b324fa tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-98da0f6a-04f0-4b76-8e9b-230ce6b324fa tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-98da0f6a-04f0-4b76-8e9b-230ce6b324fa tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:45 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-98da0f6a-04f0-4b76-8e9b-230ce6b324fa tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051430 Apr 14 17:06:45 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 73/212] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:06:45 2023] GET /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:06:45 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:06:45 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:06:45 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1952305466", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "networks": [{"uuid": "6b1137c2-ea7b-406d-86c9-407c314c8247"}]}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:46 user devstack@n-api.service[61933]: DEBUG nova.network.neutron [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] validate_networks() for [('6b1137c2-ea7b-406d-86c9-407c314c8247', None, None, None, None, None)] {{(pid=61933) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:06:46 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Flavor limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:06:46 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Image limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:06:46 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Flavor pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:06:46 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Image pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:06:46 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:06:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:46 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Getting quotas for project 5c8f41946e544d0c93cbceb3d03e50a5. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:06:46 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Getting quotas for user 01d0e8ec192748edbe2576ef1c1e1cb5 and project 5c8f41946e544d0c93cbceb3d03e50a5. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:06:46 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Going to run 1 instances... {{(pid=61933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:06:46 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:06:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-bc09000d-e465-430d-be54-81da4715cc09 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.566500 Apr 14 17:06:46 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 71/213] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:06:45 2023] POST /compute/v2.1/servers => generated 378 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:06:46 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=11 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:06:46 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=21 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:06:46 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-cbf42780-49bf-4a19-9ea8-dcf66f319ca4 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:46 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-cbf42780-49bf-4a19-9ea8-dcf66f319ca4 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:46 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-cbf42780-49bf-4a19-9ea8-dcf66f319ca4 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d0e8ec192748edbe2576ef1c1e1cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8f41946e544d0c93cbceb3d03e50a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:06:46 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-cbf42780-49bf-4a19-9ea8-dcf66f319ca4 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c51fc1f-dcf6-4c42-8a4f-4b489c270895" status: 200 len: 1212 microversion: 2.1 time: 0.076746 Apr 14 17:06:46 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 70/214] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:06:46 2023] GET /compute/v2.1/servers/8c51fc1f-dcf6-4c42-8a4f-4b489c270895 => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:06:49 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-fbde7ebe-1864-49d9-8f72-dc163b968c48 req-a2ea7ca3-5d51-4412-abd0-70e68fce2a88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c51fc1f-dcf6-4c42-8a4f-4b489c270895", "tag": "179579bb-9a96-4128-bdc5-35cbeca29ff5"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-fbde7ebe-1864-49d9-8f72-dc163b968c48 req-a2ea7ca3-5d51-4412-abd0-70e68fce2a88 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-fbde7ebe-1864-49d9-8f72-dc163b968c48 req-a2ea7ca3-5d51-4412-abd0-70e68fce2a88 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-fbde7ebe-1864-49d9-8f72-dc163b968c48 req-a2ea7ca3-5d51-4412-abd0-70e68fce2a88 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:49 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-fbde7ebe-1864-49d9-8f72-dc163b968c48 req-a2ea7ca3-5d51-4412-abd0-70e68fce2a88 service nova] Creating event network-changed:179579bb-9a96-4128-bdc5-35cbeca29ff5 for instance 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 on user Apr 14 17:06:49 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-fbde7ebe-1864-49d9-8f72-dc163b968c48 req-a2ea7ca3-5d51-4412-abd0-70e68fce2a88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.026815 Apr 14 17:06:49 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 74/215] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:06:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:51 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-ef638a10-273d-467c-926c-90a7ecdfe553 req-f293bd88-3580-449f-b28f-9af55ed4dff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c51fc1f-dcf6-4c42-8a4f-4b489c270895", "name": "network-vif-plugged", "status": "completed", "tag": "179579bb-9a96-4128-bdc5-35cbeca29ff5"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:51 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ef638a10-273d-467c-926c-90a7ecdfe553 req-f293bd88-3580-449f-b28f-9af55ed4dff8 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:51 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ef638a10-273d-467c-926c-90a7ecdfe553 req-f293bd88-3580-449f-b28f-9af55ed4dff8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:51 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ef638a10-273d-467c-926c-90a7ecdfe553 req-f293bd88-3580-449f-b28f-9af55ed4dff8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:51 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-ef638a10-273d-467c-926c-90a7ecdfe553 req-f293bd88-3580-449f-b28f-9af55ed4dff8 service nova] Creating event network-vif-plugged:179579bb-9a96-4128-bdc5-35cbeca29ff5 for instance 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 on user Apr 14 17:06:51 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-ef638a10-273d-467c-926c-90a7ecdfe553 req-f293bd88-3580-449f-b28f-9af55ed4dff8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029651 Apr 14 17:06:51 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 72/216] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:06:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:53 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-af8341bd-aa59-44c5-8363-051cd2316168 req-53f55e90-359f-48f7-8fe7-2fbdc2949f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c51fc1f-dcf6-4c42-8a4f-4b489c270895", "name": "network-vif-plugged", "status": "completed", "tag": "179579bb-9a96-4128-bdc5-35cbeca29ff5"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-af8341bd-aa59-44c5-8363-051cd2316168 req-53f55e90-359f-48f7-8fe7-2fbdc2949f07 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-af8341bd-aa59-44c5-8363-051cd2316168 req-53f55e90-359f-48f7-8fe7-2fbdc2949f07 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-af8341bd-aa59-44c5-8363-051cd2316168 req-53f55e90-359f-48f7-8fe7-2fbdc2949f07 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:53 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-af8341bd-aa59-44c5-8363-051cd2316168 req-53f55e90-359f-48f7-8fe7-2fbdc2949f07 service nova] Creating event network-vif-plugged:179579bb-9a96-4128-bdc5-35cbeca29ff5 for instance 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 on user Apr 14 17:06:53 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-af8341bd-aa59-44c5-8363-051cd2316168 req-53f55e90-359f-48f7-8fe7-2fbdc2949f07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038162 Apr 14 17:06:53 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 71/217] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:06:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:06:55 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-d36ad331-653e-4901-984f-8d4a9191297c tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:55 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-d36ad331-653e-4901-984f-8d4a9191297c tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:06:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d36ad331-653e-4901-984f-8d4a9191297c tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d36ad331-653e-4901-984f-8d4a9191297c tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d36ad331-653e-4901-984f-8d4a9191297c tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d36ad331-653e-4901-984f-8d4a9191297c tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:06:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d36ad331-653e-4901-984f-8d4a9191297c tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:06:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d36ad331-653e-4901-984f-8d4a9191297c tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:06:55 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-d36ad331-653e-4901-984f-8d4a9191297c tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] HTTP exception thrown: Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 could not be found. Apr 14 17:06:55 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-d36ad331-653e-4901-984f-8d4a9191297c tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Request method failure captured: Apr 14 17:06:55 user devstack@n-api.service[61935]: request: GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9 HTTP/1.1 Apr 14 17:06:55 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:06:55 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:06:55 user devstack@n-api.service[61935]: Connection: close Apr 14 17:06:55 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:06:55 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:06:55 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:06:55 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:06:55 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:06:55 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYda48k-T7oB577bK5ylkyjZr_zmI94jPoVehGecztdCmz8l6BVUKx4MjpzE544f3tSgOoao2p2POYWQEq_LzNVqtijCKh61yYnyk5pFqC5S6YFto1keI4uRW1hak1BgwqaOB_RCbG5OIunmtzweT75OWA648O6DqiNlfsLSRYdqGIY Apr 14 17:06:55 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:06:55 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:06:55 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:06:55 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:06:55 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:06:55 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:06:55 user devstack@n-api.service[61935]: X-Project-Id: 6431ad1110e748baaab4a94037e60782 Apr 14 17:06:55 user devstack@n-api.service[61935]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1459567257 Apr 14 17:06:55 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:06:55 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:06:55 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6431ad1110e748baaab4a94037e60782"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6431ad1110e748baaab4a94037e60782"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6431ad1110e748baaab4a94037e60782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:06:55 user devstack@n-api.service[61935]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1459567257 Apr 14 17:06:55 user devstack@n-api.service[61935]: X-Tenant-Id: 6431ad1110e748baaab4a94037e60782 Apr 14 17:06:55 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1459567257 Apr 14 17:06:55 user devstack@n-api.service[61935]: X-User: tempest-AttachSCSIVolumeTestJSON-1459567257-project-member Apr 14 17:06:55 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:06:55 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:06:55 user devstack@n-api.service[61935]: X-User-Id: d53afcd6995e4e7dbced957359802022 Apr 14 17:06:55 user devstack@n-api.service[61935]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1459567257-project-member Apr 14 17:06:55 user devstack@n-api.service[61935]: method: > Apr 14 17:06:55 user devstack@n-api.service[61935]: exception: Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 could not be found. Apr 14 17:06:55 user devstack@n-api.service[61935]: action_args: {'id': '80bd1dd9-b80e-4533-98d5-0ca798bc4be9'} Apr 14 17:06:55 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 could not be found. Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 could not be found. Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 could not be found. Apr 14 17:06:55 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:06:55 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-d36ad331-653e-4901-984f-8d4a9191297c tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Returning 404 to user: Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:06:55 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-d36ad331-653e-4901-984f-8d4a9191297c tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9" status: 404 len: 111 microversion: 2.1 time: 0.039521 Apr 14 17:06:55 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 75/218] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:06:55 2023] GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:06:55 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b5b783da-6a54-4c52-a1ae-0dc830839939 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Calling method '.version_select at 0x7fe19d15ea70>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:06:55 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-b5b783da-6a54-4c52-a1ae-0dc830839939 tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254425015" status: 202 len: 0 microversion: 2.1 time: 0.024632 Apr 14 17:06:55 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 73/219] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 17:06:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254425015 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:06:59 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:06:59 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-1ba5d091-256f-4d07-9519-00a4f9b9d4aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Action: 'create', calling method: .version_select at 0x7fe19d0d6560>, body: {"keypair": {"name": "tempest-keypair-635785217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtCXG6l0rrkl4qyoiIMqjRj/li2zlFw/PcmM/xSBKc4wAilxz0dmaj9DPtwkHqFaMLKfhqkERJ8hlmu+fXJyAgqyS180BQi7uMX2L/EeX2S4MaoWJKeXDMk+QWKh5W/3g=="}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:06:59 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-1ba5d091-256f-4d07-9519-00a4f9b9d4aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Getting quotas for project 447e75d0cc144b9ab741d8591af3959e. Resources: {'key_pairs'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:06:59 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-1ba5d091-256f-4d07-9519-00a4f9b9d4aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Getting quotas for user eef6f58f76314333b233365266ef5c57 and project 447e75d0cc144b9ab741d8591af3959e. Resources: {'key_pairs'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:07:00 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-1ba5d091-256f-4d07-9519-00a4f9b9d4aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.051740 Apr 14 17:07:00 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 72/220] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 17:06:59 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 17:07:00 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a0243e13-9c1b-4189-8a75-06bd53e3ee8d tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:00 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-a0243e13-9c1b-4189-8a75-06bd53e3ee8d tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-f0edfd30-881b-4180-958a-09c360f5d3ef tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a0243e13-9c1b-4189-8a75-06bd53e3ee8d tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-f0edfd30-881b-4180-958a-09c360f5d3ef tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a0243e13-9c1b-4189-8a75-06bd53e3ee8d tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a0243e13-9c1b-4189-8a75-06bd53e3ee8d tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a0243e13-9c1b-4189-8a75-06bd53e3ee8d tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a0243e13-9c1b-4189-8a75-06bd53e3ee8d tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a0243e13-9c1b-4189-8a75-06bd53e3ee8d tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f0edfd30-881b-4180-958a-09c360f5d3ef tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f0edfd30-881b-4180-958a-09c360f5d3ef tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f0edfd30-881b-4180-958a-09c360f5d3ef tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f0edfd30-881b-4180-958a-09c360f5d3ef tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f0edfd30-881b-4180-958a-09c360f5d3ef tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f0edfd30-881b-4180-958a-09c360f5d3ef tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:00 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-f0edfd30-881b-4180-958a-09c360f5d3ef tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] HTTP exception thrown: Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 could not be found. Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-f0edfd30-881b-4180-958a-09c360f5d3ef tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Request method failure captured: Apr 14 17:07:00 user devstack@n-api.service[61933]: request: DELETE /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9 HTTP/1.1 Apr 14 17:07:00 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:07:00 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:07:00 user devstack@n-api.service[61933]: Connection: close Apr 14 17:07:00 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:07:00 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:07:00 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:07:00 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:07:00 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:07:00 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYda48k-T7oB577bK5ylkyjZr_zmI94jPoVehGecztdCmz8l6BVUKx4MjpzE544f3tSgOoao2p2POYWQEq_LzNVqtijCKh61yYnyk5pFqC5S6YFto1keI4uRW1hak1BgwqaOB_RCbG5OIunmtzweT75OWA648O6DqiNlfsLSRYdqGIY Apr 14 17:07:00 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:07:00 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:07:00 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:07:00 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:07:00 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:07:00 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:07:00 user devstack@n-api.service[61933]: X-Project-Id: 6431ad1110e748baaab4a94037e60782 Apr 14 17:07:00 user devstack@n-api.service[61933]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1459567257 Apr 14 17:07:00 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:07:00 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:07:00 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6431ad1110e748baaab4a94037e60782"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6431ad1110e748baaab4a94037e60782"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6431ad1110e748baaab4a94037e60782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:07:00 user devstack@n-api.service[61933]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1459567257 Apr 14 17:07:00 user devstack@n-api.service[61933]: X-Tenant-Id: 6431ad1110e748baaab4a94037e60782 Apr 14 17:07:00 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1459567257 Apr 14 17:07:00 user devstack@n-api.service[61933]: X-User: tempest-AttachSCSIVolumeTestJSON-1459567257-project-member Apr 14 17:07:00 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:07:00 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:07:00 user devstack@n-api.service[61933]: X-User-Id: d53afcd6995e4e7dbced957359802022 Apr 14 17:07:00 user devstack@n-api.service[61933]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1459567257-project-member Apr 14 17:07:00 user devstack@n-api.service[61933]: method: > Apr 14 17:07:00 user devstack@n-api.service[61933]: exception: Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 could not be found. Apr 14 17:07:00 user devstack@n-api.service[61933]: action_args: {'id': '80bd1dd9-b80e-4533-98d5-0ca798bc4be9'} Apr 14 17:07:00 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 could not be found. Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 could not be found. Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 could not be found. Apr 14 17:07:00 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-f0edfd30-881b-4180-958a-09c360f5d3ef tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Returning 404 to user: Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:07:00 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-f0edfd30-881b-4180-958a-09c360f5d3ef tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9" status: 404 len: 111 microversion: 2.1 time: 0.051005 Apr 14 17:07:00 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 74/221] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:07:00 2023] DELETE /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-892390d6-d9a2-4c45-8717-3cd83006ceee tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-892390d6-d9a2-4c45-8717-3cd83006ceee tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] [instance: 80bd1dd9-b80e-4533-98d5-0ca798bc4be9] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-892390d6-d9a2-4c45-8717-3cd83006ceee tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-892390d6-d9a2-4c45-8717-3cd83006ceee tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:00 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-a0243e13-9c1b-4189-8a75-06bd53e3ee8d tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173/os-instance-actions/req-80eed5af-6ede-4acb-b162-b963896fef98" status: 200 len: 503 microversion: 2.49 time: 0.082392 Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-892390d6-d9a2-4c45-8717-3cd83006ceee tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:00 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 76/222] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 17:07:00 2023] GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173/os-instance-actions/req-80eed5af-6ede-4acb-b162-b963896fef98 => generated 503 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-892390d6-d9a2-4c45-8717-3cd83006ceee tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-892390d6-d9a2-4c45-8717-3cd83006ceee tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-892390d6-d9a2-4c45-8717-3cd83006ceee tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b2700926-135f-4676-b360-a948f65c147b tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-b2700926-135f-4676-b360-a948f65c147b tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:00 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-892390d6-d9a2-4c45-8717-3cd83006ceee tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] HTTP exception thrown: Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 could not be found. Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-892390d6-d9a2-4c45-8717-3cd83006ceee tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Request method failure captured: Apr 14 17:07:00 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9 HTTP/1.1 Apr 14 17:07:00 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:07:00 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:07:00 user devstack@n-api.service[61934]: Connection: close Apr 14 17:07:00 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:07:00 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:07:00 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:07:00 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:07:00 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:07:00 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYda48k-T7oB577bK5ylkyjZr_zmI94jPoVehGecztdCmz8l6BVUKx4MjpzE544f3tSgOoao2p2POYWQEq_LzNVqtijCKh61yYnyk5pFqC5S6YFto1keI4uRW1hak1BgwqaOB_RCbG5OIunmtzweT75OWA648O6DqiNlfsLSRYdqGIY Apr 14 17:07:00 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:07:00 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:07:00 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:07:00 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:07:00 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:07:00 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:07:00 user devstack@n-api.service[61934]: X-Project-Id: 6431ad1110e748baaab4a94037e60782 Apr 14 17:07:00 user devstack@n-api.service[61934]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1459567257 Apr 14 17:07:00 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:07:00 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:07:00 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6431ad1110e748baaab4a94037e60782"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6431ad1110e748baaab4a94037e60782"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6431ad1110e748baaab4a94037e60782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:07:00 user devstack@n-api.service[61934]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1459567257 Apr 14 17:07:00 user devstack@n-api.service[61934]: X-Tenant-Id: 6431ad1110e748baaab4a94037e60782 Apr 14 17:07:00 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1459567257 Apr 14 17:07:00 user devstack@n-api.service[61934]: X-User: tempest-AttachSCSIVolumeTestJSON-1459567257-project-member Apr 14 17:07:00 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:07:00 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:07:00 user devstack@n-api.service[61934]: X-User-Id: d53afcd6995e4e7dbced957359802022 Apr 14 17:07:00 user devstack@n-api.service[61934]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1459567257-project-member Apr 14 17:07:00 user devstack@n-api.service[61934]: method: > Apr 14 17:07:00 user devstack@n-api.service[61934]: exception: Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 could not be found. Apr 14 17:07:00 user devstack@n-api.service[61934]: action_args: {'id': '80bd1dd9-b80e-4533-98d5-0ca798bc4be9'} Apr 14 17:07:00 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 could not be found. Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 could not be found. Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 could not be found. Apr 14 17:07:00 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-892390d6-d9a2-4c45-8717-3cd83006ceee tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] Returning 404 to user: Instance 80bd1dd9-b80e-4533-98d5-0ca798bc4be9 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:07:00 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-892390d6-d9a2-4c45-8717-3cd83006ceee tempest-AttachSCSIVolumeTestJSON-1459567257 tempest-AttachSCSIVolumeTestJSON-1459567257-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9" status: 404 len: 111 microversion: 2.1 time: 0.033981 Apr 14 17:07:00 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 73/223] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:07:00 2023] GET /compute/v2.1/servers/80bd1dd9-b80e-4533-98d5-0ca798bc4be9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b2700926-135f-4676-b360-a948f65c147b tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b2700926-135f-4676-b360-a948f65c147b tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b2700926-135f-4676-b360-a948f65c147b tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b2700926-135f-4676-b360-a948f65c147b tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b2700926-135f-4676-b360-a948f65c147b tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b2700926-135f-4676-b360-a948f65c147b tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:00 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-b2700926-135f-4676-b360-a948f65c147b tempest-TaggedAttachmentsTest-957922042 tempest-TaggedAttachmentsTest-957922042-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173/os-instance-actions/req-80eed5af-6ede-4acb-b162-b963896fef98" status: 200 len: 503 microversion: 2.49 time: 0.092129 Apr 14 17:07:00 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 75/224] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 17:07:00 2023] GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173/os-instance-actions/req-80eed5af-6ede-4acb-b162-b963896fef98 => generated 503 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 17:07:00 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-8ca5d1a2-b351-447b-a4d7-ffcd7abd1434 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:00 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-8ca5d1a2-b351-447b-a4d7-ffcd7abd1434 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8ca5d1a2-b351-447b-a4d7-ffcd7abd1434 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8ca5d1a2-b351-447b-a4d7-ffcd7abd1434 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8ca5d1a2-b351-447b-a4d7-ffcd7abd1434 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8ca5d1a2-b351-447b-a4d7-ffcd7abd1434 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8ca5d1a2-b351-447b-a4d7-ffcd7abd1434 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8ca5d1a2-b351-447b-a4d7-ffcd7abd1434 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:00 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-8ca5d1a2-b351-447b-a4d7-ffcd7abd1434 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] 10.0.0.210 "GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.040479 Apr 14 17:07:00 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 77/225] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 17:07:00 2023] GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:00 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Going to try to terminate instance {{(pid=61934) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:07:00 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-4403b523-8a3c-4873-a000-d4ebc5a99b9d tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173" status: 204 len: 0 microversion: 2.49 time: 0.183180 Apr 14 17:07:00 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 74/226] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 17:07:00 2023] DELETE /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-7d4d61b3-ca5f-4e62-a141-148d2011adfb tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-7d4d61b3-ca5f-4e62-a141-148d2011adfb tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7d4d61b3-ca5f-4e62-a141-148d2011adfb tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7d4d61b3-ca5f-4e62-a141-148d2011adfb tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7d4d61b3-ca5f-4e62-a141-148d2011adfb tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7d4d61b3-ca5f-4e62-a141-148d2011adfb tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7d4d61b3-ca5f-4e62-a141-148d2011adfb tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7d4d61b3-ca5f-4e62-a141-148d2011adfb tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-3d441f2d-b907-499c-aec3-ea08ff47ce46 req-4ff48e1a-1172-47f5-903d-ad9c8545db15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113dda5c-a61e-423b-86ea-2fe30a113173", "name": "network-vif-unplugged", "status": "completed", "tag": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3d441f2d-b907-499c-aec3-ea08ff47ce46 req-4ff48e1a-1172-47f5-903d-ad9c8545db15 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3d441f2d-b907-499c-aec3-ea08ff47ce46 req-4ff48e1a-1172-47f5-903d-ad9c8545db15 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3d441f2d-b907-499c-aec3-ea08ff47ce46 req-4ff48e1a-1172-47f5-903d-ad9c8545db15 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:01 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-3d441f2d-b907-499c-aec3-ea08ff47ce46 req-4ff48e1a-1172-47f5-903d-ad9c8545db15 service nova] Creating event network-vif-unplugged:34ea1bd9-f010-4073-bf8d-351b0e85ceeb for instance 113dda5c-a61e-423b-86ea-2fe30a113173 on user Apr 14 17:07:01 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-3d441f2d-b907-499c-aec3-ea08ff47ce46 req-4ff48e1a-1172-47f5-903d-ad9c8545db15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036485 Apr 14 17:07:01 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 78/227] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:01 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-7d4d61b3-ca5f-4e62-a141-148d2011adfb tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31588acbcc345519934f4c3a395b0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924256f7ef8c4a5a832a87d1c198c50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:01 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-7d4d61b3-ca5f-4e62-a141-148d2011adfb tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c31588acbcc345519934f4c3a395b0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924256f7ef8c4a5a832a87d1c198c50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:01 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-7d4d61b3-ca5f-4e62-a141-148d2011adfb tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c31588acbcc345519934f4c3a395b0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924256f7ef8c4a5a832a87d1c198c50a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:01 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-7d4d61b3-ca5f-4e62-a141-148d2011adfb tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] 10.0.0.210 "GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173" status: 200 len: 1751 microversion: 2.49 time: 0.460197 Apr 14 17:07:01 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 76/228] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:07:00 2023] GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173 => generated 1751 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:07:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-703690354", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "b3b8775c-102b-4f49-9cd6-b1e385565e09"}, {"port": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea", "tag": "port-1"}, {"port": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3", "tag": "port-2"}, {"uuid": "ed0dc547-859c-44ef-95df-88a745ef50fd", "tag": "net-1"}, {"uuid": "ed0dc547-859c-44ef-95df-88a745ef50fd"}, {"uuid": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7312f6ad-9ca1-4e12-9d54-eecaedf53aa5", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5c124c18-317b-4292-9e62-828a770d71d1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "1ed99bca-7d21-4bc3-a44b-7ff5945370c8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "3a0f18d8-07b9-41ce-a064-e0d321058ef6", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1504903290"}], "key_name": "tempest-keypair-635785217", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:01 user devstack@n-api.service[61934]: DEBUG nova.network.neutron [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] validate_networks() for [('b3b8775c-102b-4f49-9cd6-b1e385565e09', None, None, None, None, None), (None, None, 'ac7ba708-31ec-460a-bcad-14c6b7fb2bea', None, None, None), (None, None, 'c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3', None, None, None), ('ed0dc547-859c-44ef-95df-88a745ef50fd', None, None, None, None, None), ('ed0dc547-859c-44ef-95df-88a745ef50fd', None, None, None, None, None), ('7312f6ad-9ca1-4e12-9d54-eecaedf53aa5', '10.2.2.100', None, None, None, None), ('7312f6ad-9ca1-4e12-9d54-eecaedf53aa5', '10.2.2.200', None, None, None, None)] {{(pid=61934) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:07:03 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-8711fa3a-9d67-4cf9-a77f-bea1493dc611 req-19389dc0-53da-4ae3-b429-9d2bb4b458b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113dda5c-a61e-423b-86ea-2fe30a113173", "name": "network-vif-plugged", "status": "completed", "tag": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb"}, {"server_uuid": "113dda5c-a61e-423b-86ea-2fe30a113173", "name": "network-vif-deleted", "tag": "34ea1bd9-f010-4073-bf8d-351b0e85ceeb"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8711fa3a-9d67-4cf9-a77f-bea1493dc611 req-19389dc0-53da-4ae3-b429-9d2bb4b458b7 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8711fa3a-9d67-4cf9-a77f-bea1493dc611 req-19389dc0-53da-4ae3-b429-9d2bb4b458b7 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8711fa3a-9d67-4cf9-a77f-bea1493dc611 req-19389dc0-53da-4ae3-b429-9d2bb4b458b7 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:03 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-8711fa3a-9d67-4cf9-a77f-bea1493dc611 req-19389dc0-53da-4ae3-b429-9d2bb4b458b7 service nova] Creating event network-vif-plugged:34ea1bd9-f010-4073-bf8d-351b0e85ceeb for instance 113dda5c-a61e-423b-86ea-2fe30a113173 on user Apr 14 17:07:03 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-8711fa3a-9d67-4cf9-a77f-bea1493dc611 req-19389dc0-53da-4ae3-b429-9d2bb4b458b7 service nova] Creating event network-vif-deleted:34ea1bd9-f010-4073-bf8d-351b0e85ceeb for instance 113dda5c-a61e-423b-86ea-2fe30a113173 on user Apr 14 17:07:03 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-8711fa3a-9d67-4cf9-a77f-bea1493dc611 req-19389dc0-53da-4ae3-b429-9d2bb4b458b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033705 Apr 14 17:07:03 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 79/229] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:04 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:07:04 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:07:04 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:07:04 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:07:04 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:07:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:04 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Getting quotas for project 447e75d0cc144b9ab741d8591af3959e. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:07:04 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Getting quotas for user eef6f58f76314333b233365266ef5c57 and project 447e75d0cc144b9ab741d8591af3959e. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:07:04 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Going to run 1 instances... {{(pid=61934) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:07:04 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5c124c18-317b-4292-9e62-828a770d71d1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1ed99bca-7d21-4bc3-a44b-7ff5945370c8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3a0f18d8-07b9-41ce-a064-e0d321058ef6',volume_size=None,volume_type=None)] {{(pid=61934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:07:04 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-23fc0122-b230-4cc6-a230-5ffb2d569aa0 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 3.337889 Apr 14 17:07:04 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 75/230] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 17:07:01 2023] POST /compute/v2.1/servers => generated 404 bytes in 3341 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 17:07:04 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-4debfc42-121f-4b2a-b3e8-21d0e5cc9ef4 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:04 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-4debfc42-121f-4b2a-b3e8-21d0e5cc9ef4 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:05 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-4debfc42-121f-4b2a-b3e8-21d0e5cc9ef4 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef6f58f76314333b233365266ef5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447e75d0cc144b9ab741d8591af3959e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:05 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-4debfc42-121f-4b2a-b3e8-21d0e5cc9ef4 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eef6f58f76314333b233365266ef5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447e75d0cc144b9ab741d8591af3959e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:05 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-4debfc42-121f-4b2a-b3e8-21d0e5cc9ef4 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eef6f58f76314333b233365266ef5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447e75d0cc144b9ab741d8591af3959e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:05 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-4debfc42-121f-4b2a-b3e8-21d0e5cc9ef4 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb" status: 200 len: 1278 microversion: 2.42 time: 0.083296 Apr 14 17:07:05 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 77/231] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:07:04 2023] GET /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb => generated 1278 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:07:11 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-a45c8ea4-aa85-4efe-af1e-5d56083deaef req-3057365c-e273-445d-8ceb-74bfb64566dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "tag": "ae212ee6-7785-475c-a4cf-1014775b96a5"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:11 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:11 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:11 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-a45c8ea4-aa85-4efe-af1e-5d56083deaef req-3057365c-e273-445d-8ceb-74bfb64566dc service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:11 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-a45c8ea4-aa85-4efe-af1e-5d56083deaef req-3057365c-e273-445d-8ceb-74bfb64566dc service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:11 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-a45c8ea4-aa85-4efe-af1e-5d56083deaef req-3057365c-e273-445d-8ceb-74bfb64566dc service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:11 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-a45c8ea4-aa85-4efe-af1e-5d56083deaef req-3057365c-e273-445d-8ceb-74bfb64566dc service nova] Creating event network-changed:ae212ee6-7785-475c-a4cf-1014775b96a5 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:11 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-a45c8ea4-aa85-4efe-af1e-5d56083deaef req-3057365c-e273-445d-8ceb-74bfb64566dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040164 Apr 14 17:07:11 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 80/232] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:11 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Going to try to terminate instance {{(pid=61934) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:07:11 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-64e3cac3-1639-462a-bfa6-3a346890cdd3 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7465a41f-c916-4cca-8084-7c646409007d" status: 204 len: 0 microversion: 2.1 time: 0.154491 Apr 14 17:07:11 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 76/233] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:07:11 2023] DELETE /compute/v2.1/servers/7465a41f-c916-4cca-8084-7c646409007d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:07:11 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=20 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:07:11 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-693c7e29-1b73-44ad-80d6-17072c946909 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:11 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-693c7e29-1b73-44ad-80d6-17072c946909 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-693c7e29-1b73-44ad-80d6-17072c946909 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-693c7e29-1b73-44ad-80d6-17072c946909 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-693c7e29-1b73-44ad-80d6-17072c946909 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-693c7e29-1b73-44ad-80d6-17072c946909 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-693c7e29-1b73-44ad-80d6-17072c946909 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-693c7e29-1b73-44ad-80d6-17072c946909 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:11 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-2e4518f2-f66c-4c39-91f8-ec99c7ff9bca tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] Calling method '.version_select at 0x7fe19d22bbe0>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:11 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-2e4518f2-f66c-4c39-91f8-ec99c7ff9bca tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b173eef3-b538-4ae8-b566-587034acb2d7" status: 200 len: 351 microversion: 2.1 time: 0.063056 Apr 14 17:07:11 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 81/234] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:07:11 2023] GET /compute/v2.1/os-volumes/b173eef3-b538-4ae8-b566-587034acb2d7 => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:11 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-f1e0e306-5b44-4845-9556-e368ec9a3b88 req-607cdab4-5fe9-4033-b78f-85a46235326b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7465a41f-c916-4cca-8084-7c646409007d", "name": "network-vif-unplugged", "status": "completed", "tag": "94c17c3d-5fae-4403-bc19-875a6a0ff264"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-f1e0e306-5b44-4845-9556-e368ec9a3b88 req-607cdab4-5fe9-4033-b78f-85a46235326b service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-f1e0e306-5b44-4845-9556-e368ec9a3b88 req-607cdab4-5fe9-4033-b78f-85a46235326b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-f1e0e306-5b44-4845-9556-e368ec9a3b88 req-607cdab4-5fe9-4033-b78f-85a46235326b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:11 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-f1e0e306-5b44-4845-9556-e368ec9a3b88 req-607cdab4-5fe9-4033-b78f-85a46235326b service nova] Creating event network-vif-unplugged:94c17c3d-5fae-4403-bc19-875a6a0ff264 for instance 7465a41f-c916-4cca-8084-7c646409007d on user Apr 14 17:07:11 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-f1e0e306-5b44-4845-9556-e368ec9a3b88 req-607cdab4-5fe9-4033-b78f-85a46235326b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035405 Apr 14 17:07:11 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 77/235] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:12 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-693c7e29-1b73-44ad-80d6-17072c946909 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1ea0218b044c1e94f61a07c1d14a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426156fb00db428683851cf731b680d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:12 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-693c7e29-1b73-44ad-80d6-17072c946909 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7465a41f-c916-4cca-8084-7c646409007d" status: 200 len: 1499 microversion: 2.1 time: 0.406527 Apr 14 17:07:12 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 78/236] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:07:11 2023] GET /compute/v2.1/servers/7465a41f-c916-4cca-8084-7c646409007d => generated 1499 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:07:13 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-acb7bf46-3069-48d7-8b50-dc1ef775e174 req-9e59ad12-9556-4da4-b51f-ff4cb040f1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7465a41f-c916-4cca-8084-7c646409007d", "name": "network-vif-deleted", "tag": "94c17c3d-5fae-4403-bc19-875a6a0ff264"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-acb7bf46-3069-48d7-8b50-dc1ef775e174 req-9e59ad12-9556-4da4-b51f-ff4cb040f1ab service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-acb7bf46-3069-48d7-8b50-dc1ef775e174 req-9e59ad12-9556-4da4-b51f-ff4cb040f1ab service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-acb7bf46-3069-48d7-8b50-dc1ef775e174 req-9e59ad12-9556-4da4-b51f-ff4cb040f1ab service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:13 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-acb7bf46-3069-48d7-8b50-dc1ef775e174 req-9e59ad12-9556-4da4-b51f-ff4cb040f1ab service nova] Creating event network-vif-deleted:94c17c3d-5fae-4403-bc19-875a6a0ff264 for instance 7465a41f-c916-4cca-8084-7c646409007d on user Apr 14 17:07:13 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-acb7bf46-3069-48d7-8b50-dc1ef775e174 req-9e59ad12-9556-4da4-b51f-ff4cb040f1ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036238 Apr 14 17:07:13 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 82/237] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:13 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "tag": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea"}, {"name": "network-changed", "server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "tag": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:13 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] Creating event network-changed:ac7ba708-31ec-460a-bcad-14c6b7fb2bea for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:13 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] Creating event network-changed:c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:13 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-92e97094-5606-4627-a590-238d1ec0c7e6 req-a2e7642e-6167-466c-bf79-8f5a7136cd97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032373 Apr 14 17:07:13 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 78/238] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:13 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:13 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-eb30ea68-ed99-42c0-bbf0-350c486c9194 req-129b692f-1ab4-4d15-8b9a-9ffce5f06c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7465a41f-c916-4cca-8084-7c646409007d", "name": "network-vif-plugged", "status": "completed", "tag": "94c17c3d-5fae-4403-bc19-875a6a0ff264"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-eb30ea68-ed99-42c0-bbf0-350c486c9194 req-129b692f-1ab4-4d15-8b9a-9ffce5f06c30 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-eb30ea68-ed99-42c0-bbf0-350c486c9194 req-129b692f-1ab4-4d15-8b9a-9ffce5f06c30 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-eb30ea68-ed99-42c0-bbf0-350c486c9194 req-129b692f-1ab4-4d15-8b9a-9ffce5f06c30 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:13 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-eb30ea68-ed99-42c0-bbf0-350c486c9194 req-129b692f-1ab4-4d15-8b9a-9ffce5f06c30 service nova] Creating event network-vif-plugged:94c17c3d-5fae-4403-bc19-875a6a0ff264 for instance 7465a41f-c916-4cca-8084-7c646409007d on user Apr 14 17:07:13 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-eb30ea68-ed99-42c0-bbf0-350c486c9194 req-129b692f-1ab4-4d15-8b9a-9ffce5f06c30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034940 Apr 14 17:07:13 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 79/239] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:14 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-4f8a051d-f732-4951-a47d-a1aaf0bbfec7 tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] Calling method '.version_select at 0x7fe19d22b5b0>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:14 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-4f8a051d-f732-4951-a47d-a1aaf0bbfec7 tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c0c20397-37e5-49c2-a49a-5d36b15e217e" status: 200 len: 350 microversion: 2.1 time: 0.056309 Apr 14 17:07:14 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 83/240] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:07:14 2023] GET /compute/v2.1/os-volumes/c0c20397-37e5-49c2-a49a-5d36b15e217e => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:15 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:07:15 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=10 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:07:15 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "tag": "af8c94dd-8947-4377-b332-64f1da7f7ea6"}, {"name": "network-changed", "server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "tag": "d98ca06a-3268-4d34-9fe9-524860935952"}, {"name": "network-changed", "server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "tag": "0ecf5b01-5002-45ce-95cb-730296ee6817"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:15 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] Creating event network-changed:af8c94dd-8947-4377-b332-64f1da7f7ea6 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:15 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] Creating event network-changed:d98ca06a-3268-4d34-9fe9-524860935952 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:15 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] Creating event network-changed:0ecf5b01-5002-45ce-95cb-730296ee6817 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:15 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-48a17848-ace5-4518-83af-054a98e1282b req-94ed3167-c2b4-4e58-8faf-f2e78699a583 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.035647 Apr 14 17:07:15 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 79/241] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:15 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:15 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-11acd82b-ec2d-430d-b86e-98792111015c tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:15 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-11acd82b-ec2d-430d-b86e-98792111015c tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:15 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:07:15 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-11acd82b-ec2d-430d-b86e-98792111015c tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:15 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-11acd82b-ec2d-430d-b86e-98792111015c tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:15 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-11acd82b-ec2d-430d-b86e-98792111015c tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:15 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-11acd82b-ec2d-430d-b86e-98792111015c tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:15 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-11acd82b-ec2d-430d-b86e-98792111015c tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:15 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-11acd82b-ec2d-430d-b86e-98792111015c tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:15 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-11acd82b-ec2d-430d-b86e-98792111015c tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] HTTP exception thrown: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. Apr 14 17:07:15 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-11acd82b-ec2d-430d-b86e-98792111015c tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Request method failure captured: Apr 14 17:07:15 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58 HTTP/1.1 Apr 14 17:07:15 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:07:15 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:07:15 user devstack@n-api.service[61933]: Connection: close Apr 14 17:07:15 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:07:15 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:07:15 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:07:15 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:07:15 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:07:15 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYdd9FzA5Iz5H-D2o8hbMabpxAo4g0SHI3brdS3oGBrV80ufXJzx9_7nuwPjX2z8cgTRLMz1pjaHmIZnx1dG4qSr6GvbqaQ1VbNgyw9mUn-SDe8G9nX6ukrQEhb3zGE2B5Cvacn-K-ajOXF_Oey-5CXHqYdcYDYoI80gTFT3XyZSd0I Apr 14 17:07:15 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:07:15 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:07:15 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:07:15 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:07:15 user devstack@n-api.service[61933]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 17:07:15 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:07:15 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:07:15 user devstack@n-api.service[61933]: X-Project-Id: 0706fb42134445cf914a9a00b1042c01 Apr 14 17:07:15 user devstack@n-api.service[61933]: X-Project-Name: tempest-TaggedBootDevicesTest-293729122 Apr 14 17:07:15 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:07:15 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:07:15 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0706fb42134445cf914a9a00b1042c01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0706fb42134445cf914a9a00b1042c01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0706fb42134445cf914a9a00b1042c01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:07:15 user devstack@n-api.service[61933]: X-Tenant: tempest-TaggedBootDevicesTest-293729122 Apr 14 17:07:15 user devstack@n-api.service[61933]: X-Tenant-Id: 0706fb42134445cf914a9a00b1042c01 Apr 14 17:07:15 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-TaggedBootDevicesTest-293729122 Apr 14 17:07:15 user devstack@n-api.service[61933]: X-User: tempest-TaggedBootDevicesTest-293729122-project-member Apr 14 17:07:15 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:07:15 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:07:15 user devstack@n-api.service[61933]: X-User-Id: 029c39b7ada54f7b9cb106f054ec8a0c Apr 14 17:07:15 user devstack@n-api.service[61933]: X-User-Name: tempest-TaggedBootDevicesTest-293729122-project-member Apr 14 17:07:15 user devstack@n-api.service[61933]: method: > Apr 14 17:07:15 user devstack@n-api.service[61933]: exception: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. Apr 14 17:07:15 user devstack@n-api.service[61933]: action_args: {'id': 'd8483240-2bf3-42cd-bf10-5d8231303e58'} Apr 14 17:07:15 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. Apr 14 17:07:15 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:15 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-11acd82b-ec2d-430d-b86e-98792111015c tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Returning 404 to user: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:07:15 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-11acd82b-ec2d-430d-b86e-98792111015c tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58" status: 404 len: 111 microversion: 2.32 time: 0.036606 Apr 14 17:07:15 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 80/242] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:07:15 2023] GET /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:07:15 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-b962d886-b4ad-4130-8f0d-40a04af9c808 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Calling method '.version_select at 0x7fe19cf59990>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:15 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-b962d886-b4ad-4130-8f0d-40a04af9c808 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-547297741" status: 204 len: 0 microversion: 2.32 time: 0.026038 Apr 14 17:07:15 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 84/243] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 17:07:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-547297741 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 17:07:17 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-61d6c023-b6c0-49cb-a132-a04ab2aadfce req-995f1aae-1752-49e5-a326-c9bc9189ff26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "tag": "84d71284-fb7a-4263-8388-5526e6d4e033"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:17 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:07:17 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-61d6c023-b6c0-49cb-a132-a04ab2aadfce req-995f1aae-1752-49e5-a326-c9bc9189ff26 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:17 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-61d6c023-b6c0-49cb-a132-a04ab2aadfce req-995f1aae-1752-49e5-a326-c9bc9189ff26 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:17 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-61d6c023-b6c0-49cb-a132-a04ab2aadfce req-995f1aae-1752-49e5-a326-c9bc9189ff26 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:17 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:07:17 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-61d6c023-b6c0-49cb-a132-a04ab2aadfce req-995f1aae-1752-49e5-a326-c9bc9189ff26 service nova] Creating event network-changed:84d71284-fb7a-4263-8388-5526e6d4e033 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:17 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-61d6c023-b6c0-49cb-a132-a04ab2aadfce req-995f1aae-1752-49e5-a326-c9bc9189ff26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033815 Apr 14 17:07:17 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 80/244] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:18 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-98e3065b-5330-49f7-8d8d-2400363e4a95 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:18 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-98e3065b-5330-49f7-8d8d-2400363e4a95 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:18 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:07:18 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-98e3065b-5330-49f7-8d8d-2400363e4a95 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:18 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-98e3065b-5330-49f7-8d8d-2400363e4a95 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:18 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-98e3065b-5330-49f7-8d8d-2400363e4a95 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:18 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-98e3065b-5330-49f7-8d8d-2400363e4a95 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:18 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-98e3065b-5330-49f7-8d8d-2400363e4a95 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:18 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-98e3065b-5330-49f7-8d8d-2400363e4a95 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:18 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-98e3065b-5330-49f7-8d8d-2400363e4a95 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050677 Apr 14 17:07:18 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 81/245] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:07:18 2023] GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:07:18 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-1b932c5f-2926-40c3-a036-b9be589f5fec tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] Calling method '.version_select at 0x7fe19cf595a0>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:18 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:18 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:18 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:18 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:18 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:18 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:18 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:18 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:18 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Going to try to terminate instance {{(pid=61934) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:07:18 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-1b932c5f-2926-40c3-a036-b9be589f5fec tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/67069e7e-c6ff-42a1-b808-ecce331fc303" status: 200 len: 350 microversion: 2.1 time: 0.077274 Apr 14 17:07:18 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 85/246] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:07:18 2023] GET /compute/v2.1/os-volumes/67069e7e-c6ff-42a1-b808-ecce331fc303 => generated 350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:18 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-089a09d3-c439-4226-86d1-22946d3a2309 tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] Calling method '.version_select at 0x7fe19d133be0>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:18 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-70b82260-c3e3-4eff-9fd6-59b6185607de tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1" status: 204 len: 0 microversion: 2.1 time: 0.162094 Apr 14 17:07:18 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 81/247] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:07:18 2023] DELETE /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:07:18 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a006800f-b4af-4f4b-b59a-e3faaa8233d5 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:18 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-a006800f-b4af-4f4b-b59a-e3faaa8233d5 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:18 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:07:18 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a006800f-b4af-4f4b-b59a-e3faaa8233d5 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:18 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a006800f-b4af-4f4b-b59a-e3faaa8233d5 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:18 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a006800f-b4af-4f4b-b59a-e3faaa8233d5 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:18 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a006800f-b4af-4f4b-b59a-e3faaa8233d5 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:18 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a006800f-b4af-4f4b-b59a-e3faaa8233d5 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:18 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a006800f-b4af-4f4b-b59a-e3faaa8233d5 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:18 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=33 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:07:18 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-089a09d3-c439-4226-86d1-22946d3a2309 tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.144131 Apr 14 17:07:18 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 82/248] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 17:07:18 2023] GET /compute/v2.1/os-volumes => generated 1034 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:07:19 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-ed747c3d-9d4d-4ddf-94ee-a2d7e9b86e30 tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] Calling method '.version_select at 0x7fe19d134f70>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:19 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-ed747c3d-9d4d-4ddf-94ee-a2d7e9b86e30 tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.100690 Apr 14 17:07:19 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 82/249] 10.0.0.210 () {62 vars in 1226 bytes} [Fri Apr 14 17:07:18 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:19 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-541ab203-e4da-4544-816b-11dba4b2c9b6 tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] Calling method '.version_select at 0x7fe19d07e9e0>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:19 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-a006800f-b4af-4f4b-b59a-e3faaa8233d5 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79ebfd1410c4ffda69bc3bfaebbc25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21607283fae4bd0a679948ea8fa4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-541ab203-e4da-4544-816b-11dba4b2c9b6 tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.140588 Apr 14 17:07:19 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 83/250] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 17:07:19 2023] GET /compute/v2.1/os-volumes => generated 1034 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:07:19 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-a006800f-b4af-4f4b-b59a-e3faaa8233d5 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1" status: 200 len: 1650 microversion: 2.1 time: 0.320372 Apr 14 17:07:19 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 86/251] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:07:18 2023] GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1 => generated 1650 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:07:19 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-351f23a8-8ad4-4e15-a2bb-9ab915bf5080 tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] Calling method '.version_select at 0x7fe19d0d4d30>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:19 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-91683908-aa45-45c3-b639-b44f7999492a req-280b1716-2325-4ead-aafa-05997476b1fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53cfe1f-c915-4a74-8512-84a97147f1d1", "name": "network-vif-unplugged", "status": "completed", "tag": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-91683908-aa45-45c3-b639-b44f7999492a req-280b1716-2325-4ead-aafa-05997476b1fa service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-91683908-aa45-45c3-b639-b44f7999492a req-280b1716-2325-4ead-aafa-05997476b1fa service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-91683908-aa45-45c3-b639-b44f7999492a req-280b1716-2325-4ead-aafa-05997476b1fa service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-91683908-aa45-45c3-b639-b44f7999492a req-280b1716-2325-4ead-aafa-05997476b1fa service nova] Creating event network-vif-unplugged:dfe61768-29ed-4753-b77a-dcc14e1ce6c2 for instance f53cfe1f-c915-4a74-8512-84a97147f1d1 on user Apr 14 17:07:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-91683908-aa45-45c3-b639-b44f7999492a req-280b1716-2325-4ead-aafa-05997476b1fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039830 Apr 14 17:07:19 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 84/252] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:19 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-351f23a8-8ad4-4e15-a2bb-9ab915bf5080 tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090765 Apr 14 17:07:19 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 83/253] 10.0.0.210 () {62 vars in 1244 bytes} [Fri Apr 14 17:07:19 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:19 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-2e0f5837-bfce-433b-ace2-363de2e45c60 tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] Calling method '.version_select at 0x7fe19d229090>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:19 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-2e0f5837-bfce-433b-ace2-363de2e45c60 tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.093514 Apr 14 17:07:19 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 87/254] 10.0.0.210 () {62 vars in 1247 bytes} [Fri Apr 14 17:07:19 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:19 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-11d21ce7-3e23-4db8-93e9-e713534f0f79 tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] Calling method '.version_select at 0x7fe19d1336d0>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:19 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-1d193c6b-bcc0-483c-922a-eb312f150c39 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:19 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-1d193c6b-bcc0-483c-922a-eb312f150c39 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1d193c6b-bcc0-483c-922a-eb312f150c39 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1d193c6b-bcc0-483c-922a-eb312f150c39 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1d193c6b-bcc0-483c-922a-eb312f150c39 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1d193c6b-bcc0-483c-922a-eb312f150c39 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1d193c6b-bcc0-483c-922a-eb312f150c39 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1d193c6b-bcc0-483c-922a-eb312f150c39 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-11d21ce7-3e23-4db8-93e9-e713534f0f79 tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.090703 Apr 14 17:07:19 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 85/255] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 17:07:19 2023] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:07:19 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-1d193c6b-bcc0-483c-922a-eb312f150c39 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] HTTP exception thrown: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. Apr 14 17:07:19 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-1d193c6b-bcc0-483c-922a-eb312f150c39 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Request method failure captured: Apr 14 17:07:19 user devstack@n-api.service[61934]: request: DELETE /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58 HTTP/1.1 Apr 14 17:07:19 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:07:19 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:07:19 user devstack@n-api.service[61934]: Connection: close Apr 14 17:07:19 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:07:19 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:07:19 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:07:19 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:07:19 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:07:19 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYdd9FzA5Iz5H-D2o8hbMabpxAo4g0SHI3brdS3oGBrV80ufXJzx9_7nuwPjX2z8cgTRLMz1pjaHmIZnx1dG4qSr6GvbqaQ1VbNgyw9mUn-SDe8G9nX6ukrQEhb3zGE2B5Cvacn-K-ajOXF_Oey-5CXHqYdcYDYoI80gTFT3XyZSd0I Apr 14 17:07:19 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:07:19 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:07:19 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:07:19 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:07:19 user devstack@n-api.service[61934]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 17:07:19 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:07:19 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:07:19 user devstack@n-api.service[61934]: X-Project-Id: 0706fb42134445cf914a9a00b1042c01 Apr 14 17:07:19 user devstack@n-api.service[61934]: X-Project-Name: tempest-TaggedBootDevicesTest-293729122 Apr 14 17:07:19 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:07:19 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:07:19 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0706fb42134445cf914a9a00b1042c01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0706fb42134445cf914a9a00b1042c01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0706fb42134445cf914a9a00b1042c01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:07:19 user devstack@n-api.service[61934]: X-Tenant: tempest-TaggedBootDevicesTest-293729122 Apr 14 17:07:19 user devstack@n-api.service[61934]: X-Tenant-Id: 0706fb42134445cf914a9a00b1042c01 Apr 14 17:07:19 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-TaggedBootDevicesTest-293729122 Apr 14 17:07:19 user devstack@n-api.service[61934]: X-User: tempest-TaggedBootDevicesTest-293729122-project-member Apr 14 17:07:19 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:07:19 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:07:19 user devstack@n-api.service[61934]: X-User-Id: 029c39b7ada54f7b9cb106f054ec8a0c Apr 14 17:07:19 user devstack@n-api.service[61934]: X-User-Name: tempest-TaggedBootDevicesTest-293729122-project-member Apr 14 17:07:19 user devstack@n-api.service[61934]: method: > Apr 14 17:07:19 user devstack@n-api.service[61934]: exception: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. Apr 14 17:07:19 user devstack@n-api.service[61934]: action_args: {'id': 'd8483240-2bf3-42cd-bf10-5d8231303e58'} Apr 14 17:07:19 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. Apr 14 17:07:19 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:07:19 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-069bedb2-9ca1-4c6e-b109-570d343fe5e7 tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] Calling method '.version_select at 0x7fe19cf5b520>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:19 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-1d193c6b-bcc0-483c-922a-eb312f150c39 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Returning 404 to user: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:07:19 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-1d193c6b-bcc0-483c-922a-eb312f150c39 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58" status: 404 len: 111 microversion: 2.32 time: 0.082685 Apr 14 17:07:19 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 84/256] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 17:07:19 2023] DELETE /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:07:19 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-6a71b38c-183e-436a-9caa-edbb47784a32 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:19 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-6a71b38c-183e-436a-9caa-edbb47784a32 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] [instance: d8483240-2bf3-42cd-bf10-5d8231303e58] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6a71b38c-183e-436a-9caa-edbb47784a32 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6a71b38c-183e-436a-9caa-edbb47784a32 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6a71b38c-183e-436a-9caa-edbb47784a32 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6a71b38c-183e-436a-9caa-edbb47784a32 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6a71b38c-183e-436a-9caa-edbb47784a32 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6a71b38c-183e-436a-9caa-edbb47784a32 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-6a71b38c-183e-436a-9caa-edbb47784a32 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] HTTP exception thrown: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. Apr 14 17:07:19 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-6a71b38c-183e-436a-9caa-edbb47784a32 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Request method failure captured: Apr 14 17:07:19 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58 HTTP/1.1 Apr 14 17:07:19 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:07:19 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:07:19 user devstack@n-api.service[61933]: Connection: close Apr 14 17:07:19 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:07:19 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:07:19 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:07:19 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:07:19 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:07:19 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYdd9FzA5Iz5H-D2o8hbMabpxAo4g0SHI3brdS3oGBrV80ufXJzx9_7nuwPjX2z8cgTRLMz1pjaHmIZnx1dG4qSr6GvbqaQ1VbNgyw9mUn-SDe8G9nX6ukrQEhb3zGE2B5Cvacn-K-ajOXF_Oey-5CXHqYdcYDYoI80gTFT3XyZSd0I Apr 14 17:07:19 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:07:19 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:07:19 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:07:19 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:07:19 user devstack@n-api.service[61933]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 17:07:19 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:07:19 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:07:19 user devstack@n-api.service[61933]: X-Project-Id: 0706fb42134445cf914a9a00b1042c01 Apr 14 17:07:19 user devstack@n-api.service[61933]: X-Project-Name: tempest-TaggedBootDevicesTest-293729122 Apr 14 17:07:19 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:07:19 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:07:19 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0706fb42134445cf914a9a00b1042c01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0706fb42134445cf914a9a00b1042c01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0706fb42134445cf914a9a00b1042c01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:07:19 user devstack@n-api.service[61933]: X-Tenant: tempest-TaggedBootDevicesTest-293729122 Apr 14 17:07:19 user devstack@n-api.service[61933]: X-Tenant-Id: 0706fb42134445cf914a9a00b1042c01 Apr 14 17:07:19 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-TaggedBootDevicesTest-293729122 Apr 14 17:07:19 user devstack@n-api.service[61933]: X-User: tempest-TaggedBootDevicesTest-293729122-project-member Apr 14 17:07:19 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:07:19 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:07:19 user devstack@n-api.service[61933]: X-User-Id: 029c39b7ada54f7b9cb106f054ec8a0c Apr 14 17:07:19 user devstack@n-api.service[61933]: X-User-Name: tempest-TaggedBootDevicesTest-293729122-project-member Apr 14 17:07:19 user devstack@n-api.service[61933]: method: > Apr 14 17:07:19 user devstack@n-api.service[61933]: exception: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. Apr 14 17:07:19 user devstack@n-api.service[61933]: action_args: {'id': 'd8483240-2bf3-42cd-bf10-5d8231303e58'} Apr 14 17:07:19 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. Apr 14 17:07:19 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:19 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-6a71b38c-183e-436a-9caa-edbb47784a32 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] Returning 404 to user: Instance d8483240-2bf3-42cd-bf10-5d8231303e58 could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:07:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-6a71b38c-183e-436a-9caa-edbb47784a32 tempest-TaggedBootDevicesTest-293729122 tempest-TaggedBootDevicesTest-293729122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58" status: 404 len: 111 microversion: 2.32 time: 0.029737 Apr 14 17:07:19 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 86/257] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:07:19 2023] GET /compute/v2.1/servers/d8483240-2bf3-42cd-bf10-5d8231303e58 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:07:19 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-069bedb2-9ca1-4c6e-b109-570d343fe5e7 tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085479 Apr 14 17:07:19 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 88/258] 10.0.0.210 () {62 vars in 1265 bytes} [Fri Apr 14 17:07:19 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 17:07:19 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-1d1fdeec-5bbf-46db-89b5-99c1c0383a93 tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] Calling method '.version_select at 0x7fe19d0d7b50>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:19 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-1d1fdeec-5bbf-46db-89b5-99c1c0383a93 tempest-VolumesTestJSON-266792620 tempest-VolumesTestJSON-266792620-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.103932 Apr 14 17:07:19 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 85/259] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 17:07:19 2023] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:07:20 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-09847771-eb41-4146-8e34-d9850655a00b req-a1ccbe27-00ca-4657-8d8a-561a9d232503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53cfe1f-c915-4a74-8512-84a97147f1d1", "name": "network-vif-deleted", "tag": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-09847771-eb41-4146-8e34-d9850655a00b req-a1ccbe27-00ca-4657-8d8a-561a9d232503 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-09847771-eb41-4146-8e34-d9850655a00b req-a1ccbe27-00ca-4657-8d8a-561a9d232503 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-09847771-eb41-4146-8e34-d9850655a00b req-a1ccbe27-00ca-4657-8d8a-561a9d232503 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:20 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-09847771-eb41-4146-8e34-d9850655a00b req-a1ccbe27-00ca-4657-8d8a-561a9d232503 service nova] Creating event network-vif-deleted:dfe61768-29ed-4753-b77a-dcc14e1ce6c2 for instance f53cfe1f-c915-4a74-8512-84a97147f1d1 on user Apr 14 17:07:20 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-09847771-eb41-4146-8e34-d9850655a00b req-a1ccbe27-00ca-4657-8d8a-561a9d232503 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033674 Apr 14 17:07:20 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 87/260] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:21 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-e7cdc4d4-750d-4e38-afa0-d20e3b716623 req-3807f020-b77e-47e9-9318-e15935629d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53cfe1f-c915-4a74-8512-84a97147f1d1", "name": "network-vif-plugged", "status": "completed", "tag": "dfe61768-29ed-4753-b77a-dcc14e1ce6c2"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-e7cdc4d4-750d-4e38-afa0-d20e3b716623 req-3807f020-b77e-47e9-9318-e15935629d16 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-e7cdc4d4-750d-4e38-afa0-d20e3b716623 req-3807f020-b77e-47e9-9318-e15935629d16 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-e7cdc4d4-750d-4e38-afa0-d20e3b716623 req-3807f020-b77e-47e9-9318-e15935629d16 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:21 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-e7cdc4d4-750d-4e38-afa0-d20e3b716623 req-3807f020-b77e-47e9-9318-e15935629d16 service nova] Creating event network-vif-plugged:dfe61768-29ed-4753-b77a-dcc14e1ce6c2 for instance f53cfe1f-c915-4a74-8512-84a97147f1d1 on user Apr 14 17:07:21 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-e7cdc4d4-750d-4e38-afa0-d20e3b716623 req-3807f020-b77e-47e9-9318-e15935629d16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035140 Apr 14 17:07:21 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 89/261] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:25 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-8ef13aa1-f9a7-473f-8ed1-72124de02e73 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:25 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-8ef13aa1-f9a7-473f-8ed1-72124de02e73 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8ef13aa1-f9a7-473f-8ed1-72124de02e73 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8ef13aa1-f9a7-473f-8ed1-72124de02e73 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8ef13aa1-f9a7-473f-8ed1-72124de02e73 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8ef13aa1-f9a7-473f-8ed1-72124de02e73 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8ef13aa1-f9a7-473f-8ed1-72124de02e73 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8ef13aa1-f9a7-473f-8ed1-72124de02e73 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:25 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-8ef13aa1-f9a7-473f-8ed1-72124de02e73 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d67df67ba8e4905bf7c6545c5748a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2764eee6c4071b5607f78762ca653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:25 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-8ef13aa1-f9a7-473f-8ed1-72124de02e73 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd" status: 200 len: 1672 microversion: 2.1 time: 0.226340 Apr 14 17:07:25 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 86/262] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:07:25 2023] GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd => generated 1672 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:07:26 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:26 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Going to try to start instance {{(pid=61933) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 17:07:26 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-2de71525-184f-43b8-a144-e6ef85d4358d tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97/action" status: 202 len: 0 microversion: 2.1 time: 0.077234 Apr 14 17:07:26 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 88/263] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:07:26 2023] POST /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:07:26 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-377741d9-6836-41e3-a36d-8ec0e702986b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:26 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-377741d9-6836-41e3-a36d-8ec0e702986b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-377741d9-6836-41e3-a36d-8ec0e702986b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-377741d9-6836-41e3-a36d-8ec0e702986b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-377741d9-6836-41e3-a36d-8ec0e702986b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-377741d9-6836-41e3-a36d-8ec0e702986b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-377741d9-6836-41e3-a36d-8ec0e702986b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-377741d9-6836-41e3-a36d-8ec0e702986b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:26 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-377741d9-6836-41e3-a36d-8ec0e702986b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c4734925f645248b0f9060aa78a502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8f6b39515e456c9f5a1affa9f79000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:26 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-377741d9-6836-41e3-a36d-8ec0e702986b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97" status: 200 len: 1696 microversion: 2.1 time: 0.246045 Apr 14 17:07:26 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 90/264] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:07:26 2023] GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97 => generated 1696 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:07:28 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5dc56d4-d704-4e10-8ed6-33153ab29a68"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:28 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:28 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-5a0c90b3-7ecb-49aa-ba4f-856689f59cb8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.355172 Apr 14 17:07:28 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 87/265] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:07:28 2023] POST /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd/os-volume_attachments => generated 194 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:29 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-9ba85319-c295-4cec-9eba-1c3464d621ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:29 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-9ba85319-c295-4cec-9eba-1c3464d621ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9ba85319-c295-4cec-9eba-1c3464d621ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9ba85319-c295-4cec-9eba-1c3464d621ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9ba85319-c295-4cec-9eba-1c3464d621ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9ba85319-c295-4cec-9eba-1c3464d621ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9ba85319-c295-4cec-9eba-1c3464d621ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9ba85319-c295-4cec-9eba-1c3464d621ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:30 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-9ba85319-c295-4cec-9eba-1c3464d621ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.460294 Apr 14 17:07:30 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 89/266] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 17:07:29 2023] GET /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd/os-interface => generated 283 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:31 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-b5392816-c282-4523-b32e-79e629579e3e req-cd9440b7-35b9-44cf-9e54-d2d7911f6c97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3469a45b-e63a-4871-a6c5-deece7f4ecfd", "tag": "4674caf0-77c1-4de1-a665-db3fde68e9bb"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-b5392816-c282-4523-b32e-79e629579e3e req-cd9440b7-35b9-44cf-9e54-d2d7911f6c97 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-b5392816-c282-4523-b32e-79e629579e3e req-cd9440b7-35b9-44cf-9e54-d2d7911f6c97 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-b5392816-c282-4523-b32e-79e629579e3e req-cd9440b7-35b9-44cf-9e54-d2d7911f6c97 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:31 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-b5392816-c282-4523-b32e-79e629579e3e req-cd9440b7-35b9-44cf-9e54-d2d7911f6c97 service nova] Creating event network-changed:4674caf0-77c1-4de1-a665-db3fde68e9bb for instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd on user Apr 14 17:07:31 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-b5392816-c282-4523-b32e-79e629579e3e req-cd9440b7-35b9-44cf-9e54-d2d7911f6c97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039042 Apr 14 17:07:31 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 91/267] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:31 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-9bcee3e6-c8c3-4eef-b5bf-3e3db4932010 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:31 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-9bcee3e6-c8c3-4eef-b5bf-3e3db4932010 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-9bcee3e6-c8c3-4eef-b5bf-3e3db4932010 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-9bcee3e6-c8c3-4eef-b5bf-3e3db4932010 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-9bcee3e6-c8c3-4eef-b5bf-3e3db4932010 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-9bcee3e6-c8c3-4eef-b5bf-3e3db4932010 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-9bcee3e6-c8c3-4eef-b5bf-3e3db4932010 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-9bcee3e6-c8c3-4eef-b5bf-3e3db4932010 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:31 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-9bcee3e6-c8c3-4eef-b5bf-3e3db4932010 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd/ips" status: 200 len: 109 microversion: 2.1 time: 0.068819 Apr 14 17:07:31 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 88/268] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 17:07:31 2023] GET /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd/ips => generated 109 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:31 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-8daa682c-d680-49ce-bbd4-15fcd51b9b81 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58c68d43-05ee-458b-b7d0-8bc859d6ebcb"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:31 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-8daa682c-d680-49ce-bbd4-15fcd51b9b81 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8daa682c-d680-49ce-bbd4-15fcd51b9b81 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8daa682c-d680-49ce-bbd4-15fcd51b9b81 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8daa682c-d680-49ce-bbd4-15fcd51b9b81 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8daa682c-d680-49ce-bbd4-15fcd51b9b81 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8daa682c-d680-49ce-bbd4-15fcd51b9b81 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8daa682c-d680-49ce-bbd4-15fcd51b9b81 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:31 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-8daa682c-d680-49ce-bbd4-15fcd51b9b81 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] HTTP exception thrown: Invalid volume: volume 58c68d43-05ee-458b-b7d0-8bc859d6ebcb is already attached to instances: c0488788-7b88-4c48-9fcd-02640c09feb1 Apr 14 17:07:31 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-8daa682c-d680-49ce-bbd4-15fcd51b9b81 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Request method failure captured: Apr 14 17:07:31 user devstack@n-api.service[61933]: request: POST /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd/os-volume_attachments HTTP/1.1 Apr 14 17:07:31 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:07:31 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:07:31 user devstack@n-api.service[61933]: Connection: close Apr 14 17:07:31 user devstack@n-api.service[61933]: Content-Length: 74 Apr 14 17:07:31 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:07:31 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:07:31 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:07:31 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:07:31 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYdYtBTMjEs6wq_AX7uLwl48FezTrz7FyW6CSVOm9G6i0ttgahwJf1S74Fss_9qd0JO9t5wr7pQDv25cSrw7tI0XNOdCBZPRJQlF-w0w2Xn2ZRZ5EUArK2xGuE0HglaJJpHNyoLBzYQsp9Av8_ba24psGn8qYzpzCLzlLWiMZvDXQQQ Apr 14 17:07:31 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:07:31 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:07:31 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:07:31 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:07:31 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:07:31 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:07:31 user devstack@n-api.service[61933]: X-Project-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:07:31 user devstack@n-api.service[61933]: X-Project-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:07:31 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:07:31 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:07:31 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6f341a2096b9483787b569a59f325556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:07:31 user devstack@n-api.service[61933]: X-Tenant: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:07:31 user devstack@n-api.service[61933]: X-Tenant-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:07:31 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:07:31 user devstack@n-api.service[61933]: X-User: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:07:31 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:07:31 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:07:31 user devstack@n-api.service[61933]: X-User-Id: d9c9e0d318eb4ca49d47d620682fb00a Apr 14 17:07:31 user devstack@n-api.service[61933]: X-User-Name: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:07:31 user devstack@n-api.service[61933]: Apr 14 17:07:31 user devstack@n-api.service[61933]: {"volumeAttachment": {"volumeId": "58c68d43-05ee-458b-b7d0-8bc859d6ebcb"}} Apr 14 17:07:31 user devstack@n-api.service[61933]: method: > Apr 14 17:07:31 user devstack@n-api.service[61933]: exception: Invalid volume: volume 58c68d43-05ee-458b-b7d0-8bc859d6ebcb is already attached to instances: c0488788-7b88-4c48-9fcd-02640c09feb1 Apr 14 17:07:31 user devstack@n-api.service[61933]: action_args: {'server_id': '3469a45b-e63a-4871-a6c5-deece7f4ecfd', 'body': {'volumeAttachment': {'volumeId': '58c68d43-05ee-458b-b7d0-8bc859d6ebcb'}}} Apr 14 17:07:31 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 58c68d43-05ee-458b-b7d0-8bc859d6ebcb is already attached to instances: c0488788-7b88-4c48-9fcd-02640c09feb1 Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 58c68d43-05ee-458b-b7d0-8bc859d6ebcb is already attached to instances: c0488788-7b88-4c48-9fcd-02640c09feb1 Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 58c68d43-05ee-458b-b7d0-8bc859d6ebcb is already attached to instances: c0488788-7b88-4c48-9fcd-02640c09feb1 Apr 14 17:07:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:07:31 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-8daa682c-d680-49ce-bbd4-15fcd51b9b81 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Returning 400 to user: Invalid volume: volume 58c68d43-05ee-458b-b7d0-8bc859d6ebcb is already attached to instances: c0488788-7b88-4c48-9fcd-02640c09feb1 {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:07:31 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-8daa682c-d680-49ce-bbd4-15fcd51b9b81 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.135167 Apr 14 17:07:31 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 90/269] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:07:31 2023] POST /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd/os-volume_attachments => generated 174 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 14 17:07:31 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:31 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:31 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Going to try to terminate instance {{(pid=61935) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:07:31 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-df19a69b-a233-4f9b-a6b9-b4edf38607aa tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd" status: 204 len: 0 microversion: 2.1 time: 0.168676 Apr 14 17:07:31 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 92/270] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:07:31 2023] DELETE /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:07:31 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-94d84088-cd64-4cbf-b3a9-0116a733c27b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:31 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-94d84088-cd64-4cbf-b3a9-0116a733c27b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-94d84088-cd64-4cbf-b3a9-0116a733c27b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-94d84088-cd64-4cbf-b3a9-0116a733c27b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-94d84088-cd64-4cbf-b3a9-0116a733c27b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-94d84088-cd64-4cbf-b3a9-0116a733c27b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-94d84088-cd64-4cbf-b3a9-0116a733c27b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-94d84088-cd64-4cbf-b3a9-0116a733c27b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:32 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-94d84088-cd64-4cbf-b3a9-0116a733c27b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c9e0d318eb4ca49d47d620682fb00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f341a2096b9483787b569a59f325556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:32 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-94d84088-cd64-4cbf-b3a9-0116a733c27b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd" status: 200 len: 1552 microversion: 2.1 time: 0.497537 Apr 14 17:07:32 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 89/271] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:07:31 2023] GET /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd => generated 1552 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:07:32 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-66ad698a-58ee-44bf-8087-ebbb5d5f783d req-fb58b8e4-35ce-45db-95ca-555756268106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3469a45b-e63a-4871-a6c5-deece7f4ecfd", "name": "network-vif-unplugged", "status": "completed", "tag": "4674caf0-77c1-4de1-a665-db3fde68e9bb"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:32 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-66ad698a-58ee-44bf-8087-ebbb5d5f783d req-fb58b8e4-35ce-45db-95ca-555756268106 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:32 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-66ad698a-58ee-44bf-8087-ebbb5d5f783d req-fb58b8e4-35ce-45db-95ca-555756268106 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:32 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-66ad698a-58ee-44bf-8087-ebbb5d5f783d req-fb58b8e4-35ce-45db-95ca-555756268106 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:32 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-66ad698a-58ee-44bf-8087-ebbb5d5f783d req-fb58b8e4-35ce-45db-95ca-555756268106 service nova] Creating event network-vif-unplugged:4674caf0-77c1-4de1-a665-db3fde68e9bb for instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd on user Apr 14 17:07:32 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-66ad698a-58ee-44bf-8087-ebbb5d5f783d req-fb58b8e4-35ce-45db-95ca-555756268106 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053245 Apr 14 17:07:32 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 91/272] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:33 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "name": "network-vif-plugged", "status": "completed", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}, {"server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "name": "network-vif-plugged", "status": "completed", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:33 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:33 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:33 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:33 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] Creating event network-vif-plugged:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:07:33 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] Creating event network-vif-plugged:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:07:33 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-5efab845-4132-413d-b8d9-156f92f12133 req-336d8770-af5c-4fd6-b871-15807b888f7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032610 Apr 14 17:07:33 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 93/273] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:33 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:34 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-8f9532ac-60a2-4df8-a57c-24c44a577ab5 req-e1e221d4-c736-472d-8c36-d6af7d6b798a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3469a45b-e63a-4871-a6c5-deece7f4ecfd", "name": "network-vif-plugged", "status": "completed", "tag": "4674caf0-77c1-4de1-a665-db3fde68e9bb"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:34 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8f9532ac-60a2-4df8-a57c-24c44a577ab5 req-e1e221d4-c736-472d-8c36-d6af7d6b798a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:34 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8f9532ac-60a2-4df8-a57c-24c44a577ab5 req-e1e221d4-c736-472d-8c36-d6af7d6b798a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:34 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8f9532ac-60a2-4df8-a57c-24c44a577ab5 req-e1e221d4-c736-472d-8c36-d6af7d6b798a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:34 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-8f9532ac-60a2-4df8-a57c-24c44a577ab5 req-e1e221d4-c736-472d-8c36-d6af7d6b798a service nova] Creating event network-vif-plugged:4674caf0-77c1-4de1-a665-db3fde68e9bb for instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd on user Apr 14 17:07:34 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-8f9532ac-60a2-4df8-a57c-24c44a577ab5 req-e1e221d4-c736-472d-8c36-d6af7d6b798a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047831 Apr 14 17:07:34 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 90/274] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:35 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-eec05475-c86c-4fd9-83e0-72918547d369 req-79b8a8b1-e58e-45b7-a11b-491055c0a992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3469a45b-e63a-4871-a6c5-deece7f4ecfd", "name": "network-vif-deleted", "tag": "4674caf0-77c1-4de1-a665-db3fde68e9bb"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-eec05475-c86c-4fd9-83e0-72918547d369 req-79b8a8b1-e58e-45b7-a11b-491055c0a992 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-eec05475-c86c-4fd9-83e0-72918547d369 req-79b8a8b1-e58e-45b7-a11b-491055c0a992 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-eec05475-c86c-4fd9-83e0-72918547d369 req-79b8a8b1-e58e-45b7-a11b-491055c0a992 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:35 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-eec05475-c86c-4fd9-83e0-72918547d369 req-79b8a8b1-e58e-45b7-a11b-491055c0a992 service nova] Creating event network-vif-deleted:4674caf0-77c1-4de1-a665-db3fde68e9bb for instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd on user Apr 14 17:07:35 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-eec05475-c86c-4fd9-83e0-72918547d369 req-79b8a8b1-e58e-45b7-a11b-491055c0a992 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062831 Apr 14 17:07:35 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 92/275] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 17:07:36 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-19568a80-63d3-4268-9305-1155c754179c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:36 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-19568a80-63d3-4268-9305-1155c754179c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-19568a80-63d3-4268-9305-1155c754179c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-19568a80-63d3-4268-9305-1155c754179c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-19568a80-63d3-4268-9305-1155c754179c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-19568a80-63d3-4268-9305-1155c754179c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-19568a80-63d3-4268-9305-1155c754179c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-19568a80-63d3-4268-9305-1155c754179c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:37 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-e552633c-c09a-43c9-9fb4-29c958bb18e3 req-4156b69a-279c-4b6e-befd-0ec8eee87f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:37 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-e552633c-c09a-43c9-9fb4-29c958bb18e3 req-4156b69a-279c-4b6e-befd-0ec8eee87f35 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:37 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-e552633c-c09a-43c9-9fb4-29c958bb18e3 req-4156b69a-279c-4b6e-befd-0ec8eee87f35 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:37 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-e552633c-c09a-43c9-9fb4-29c958bb18e3 req-4156b69a-279c-4b6e-befd-0ec8eee87f35 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:37 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-e552633c-c09a-43c9-9fb4-29c958bb18e3 req-4156b69a-279c-4b6e-befd-0ec8eee87f35 service nova] Creating event network-vif-plugged:ac7ba708-31ec-460a-bcad-14c6b7fb2bea for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:37 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-e552633c-c09a-43c9-9fb4-29c958bb18e3 req-4156b69a-279c-4b6e-befd-0ec8eee87f35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077818 Apr 14 17:07:37 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 91/276] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:37 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "ae212ee6-7785-475c-a4cf-1014775b96a5"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "ae212ee6-7785-475c-a4cf-1014775b96a5"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:37 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] Creating event network-vif-plugged:ae212ee6-7785-475c-a4cf-1014775b96a5 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:37 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] Creating event network-vif-plugged:ae212ee6-7785-475c-a4cf-1014775b96a5 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:37 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-ec422f10-0fc0-4264-91da-ca94134cacf0 req-f8e2444f-9741-448f-8dca-3398e989c4af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074257 Apr 14 17:07:37 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 93/277] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:37 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-19568a80-63d3-4268-9305-1155c754179c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d0e8ec192748edbe2576ef1c1e1cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8f41946e544d0c93cbceb3d03e50a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:37 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-19568a80-63d3-4268-9305-1155c754179c tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c51fc1f-dcf6-4c42-8a4f-4b489c270895" status: 200 len: 1495 microversion: 2.1 time: 1.168655 Apr 14 17:07:37 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 94/278] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:07:36 2023] GET /compute/v2.1/servers/8c51fc1f-dcf6-4c42-8a4f-4b489c270895 => generated 1495 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:07:39 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "d98ca06a-3268-4d34-9fe9-524860935952"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "d98ca06a-3268-4d34-9fe9-524860935952"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:39 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:39 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:39 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:39 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Creating event network-vif-plugged:ac7ba708-31ec-460a-bcad-14c6b7fb2bea for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:39 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Creating event network-vif-plugged:c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:39 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Creating event network-vif-plugged:c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:39 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Creating event network-vif-plugged:d98ca06a-3268-4d34-9fe9-524860935952 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:39 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] Creating event network-vif-plugged:d98ca06a-3268-4d34-9fe9-524860935952 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:39 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-6f9a280f-147e-41b6-b7d8-f03b32e840bb req-74a75b81-a130-44ec-a8de-fdf4f15e2abf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.048375 Apr 14 17:07:39 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 92/279] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:39 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:39 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "af8c94dd-8947-4377-b332-64f1da7f7ea6"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "af8c94dd-8947-4377-b332-64f1da7f7ea6"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "84d71284-fb7a-4263-8388-5526e6d4e033"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "84d71284-fb7a-4263-8388-5526e6d4e033"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Creating event network-vif-plugged:af8c94dd-8947-4377-b332-64f1da7f7ea6 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Creating event network-vif-plugged:af8c94dd-8947-4377-b332-64f1da7f7ea6 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Creating event network-vif-plugged:84d71284-fb7a-4263-8388-5526e6d4e033 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] Creating event network-vif-plugged:84d71284-fb7a-4263-8388-5526e6d4e033 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-71aaa420-9f84-4bfb-8b06-980f8a01b62d req-14268ce1-cc43-456e-a641-ed52b1e8b078 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.111079 Apr 14 17:07:39 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 94/280] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:39 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:40 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "76d1cc2c-f73e-47b3-a798-4adb640ecdc8"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:40 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:40 user devstack@n-api.service[61935]: DEBUG nova.objects.instance [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lazy-loading 'flavor' on Instance uuid d5920661-9030-4cf7-88a0-1ad789eec1bd {{(pid=61935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:07:41 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-40a38a8d-0bd6-4374-b674-bda9b4f2f12d tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd/action" status: 200 len: 29 microversion: 2.1 time: 0.238240 Apr 14 17:07:41 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 95/281] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:07:40 2023] POST /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd/action => generated 29 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:07:41 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-ec65935b-6662-4da2-a2e8-2d1d76cad568 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:41 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-ec65935b-6662-4da2-a2e8-2d1d76cad568 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ec65935b-6662-4da2-a2e8-2d1d76cad568 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ec65935b-6662-4da2-a2e8-2d1d76cad568 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ec65935b-6662-4da2-a2e8-2d1d76cad568 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ec65935b-6662-4da2-a2e8-2d1d76cad568 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ec65935b-6662-4da2-a2e8-2d1d76cad568 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ec65935b-6662-4da2-a2e8-2d1d76cad568 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:41 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-ec65935b-6662-4da2-a2e8-2d1d76cad568 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d67df67ba8e4905bf7c6545c5748a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2764eee6c4071b5607f78762ca653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:41 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "0ecf5b01-5002-45ce-95cb-730296ee6817"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "0ecf5b01-5002-45ce-95cb-730296ee6817"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:41 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-ec65935b-6662-4da2-a2e8-2d1d76cad568 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd" status: 200 len: 1724 microversion: 2.1 time: 0.306409 Apr 14 17:07:41 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 93/282] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:07:41 2023] GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:07:41 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:41 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:41 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:41 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] Creating event network-vif-plugged:0ecf5b01-5002-45ce-95cb-730296ee6817 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:41 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] Creating event network-vif-plugged:0ecf5b01-5002-45ce-95cb-730296ee6817 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:07:41 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-de1350ca-98ef-4cd8-9cb0-638efb2f3e52 req-2b9aa517-c551-488e-bdd5-1f6f6472c65f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056729 Apr 14 17:07:41 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 95/283] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:41 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:42 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-37737f00-954a-41cc-bf0a-af918d8f28d3 req-c0f28c7f-c01d-4555-86fa-90b11b6d6798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5920661-9030-4cf7-88a0-1ad789eec1bd", "name": "network-vif-unplugged", "status": "completed", "tag": "526282d7-c5ce-4ae0-9745-4e43477222f0"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:42 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-37737f00-954a-41cc-bf0a-af918d8f28d3 req-c0f28c7f-c01d-4555-86fa-90b11b6d6798 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:42 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-37737f00-954a-41cc-bf0a-af918d8f28d3 req-c0f28c7f-c01d-4555-86fa-90b11b6d6798 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:42 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-37737f00-954a-41cc-bf0a-af918d8f28d3 req-c0f28c7f-c01d-4555-86fa-90b11b6d6798 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:42 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-37737f00-954a-41cc-bf0a-af918d8f28d3 req-c0f28c7f-c01d-4555-86fa-90b11b6d6798 service nova] Creating event network-vif-unplugged:526282d7-c5ce-4ae0-9745-4e43477222f0 for instance d5920661-9030-4cf7-88a0-1ad789eec1bd on user Apr 14 17:07:42 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-37737f00-954a-41cc-bf0a-af918d8f28d3 req-c0f28c7f-c01d-4555-86fa-90b11b6d6798 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040704 Apr 14 17:07:42 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 96/284] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:44 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-ca457083-3d31-4e7f-ad89-852fbe334662 req-975e7173-79c2-4274-9a03-dc840df071fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5920661-9030-4cf7-88a0-1ad789eec1bd", "name": "network-vif-plugged", "status": "completed", "tag": "526282d7-c5ce-4ae0-9745-4e43477222f0"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ca457083-3d31-4e7f-ad89-852fbe334662 req-975e7173-79c2-4274-9a03-dc840df071fc service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ca457083-3d31-4e7f-ad89-852fbe334662 req-975e7173-79c2-4274-9a03-dc840df071fc service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ca457083-3d31-4e7f-ad89-852fbe334662 req-975e7173-79c2-4274-9a03-dc840df071fc service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:44 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-ca457083-3d31-4e7f-ad89-852fbe334662 req-975e7173-79c2-4274-9a03-dc840df071fc service nova] Creating event network-vif-plugged:526282d7-c5ce-4ae0-9745-4e43477222f0 for instance d5920661-9030-4cf7-88a0-1ad789eec1bd on user Apr 14 17:07:44 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-ca457083-3d31-4e7f-ad89-852fbe334662 req-975e7173-79c2-4274-9a03-dc840df071fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088869 Apr 14 17:07:44 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 94/285] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:47 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-844efca3-25bc-4136-a871-40bd4bddccad req-3ef0866c-4b77-4522-87ff-01f308239e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5920661-9030-4cf7-88a0-1ad789eec1bd", "name": "network-vif-plugged", "status": "completed", "tag": "526282d7-c5ce-4ae0-9745-4e43477222f0"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-844efca3-25bc-4136-a871-40bd4bddccad req-3ef0866c-4b77-4522-87ff-01f308239e31 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-844efca3-25bc-4136-a871-40bd4bddccad req-3ef0866c-4b77-4522-87ff-01f308239e31 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-844efca3-25bc-4136-a871-40bd4bddccad req-3ef0866c-4b77-4522-87ff-01f308239e31 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:47 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:07:47 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-844efca3-25bc-4136-a871-40bd4bddccad req-3ef0866c-4b77-4522-87ff-01f308239e31 service nova] Creating event network-vif-plugged:526282d7-c5ce-4ae0-9745-4e43477222f0 for instance d5920661-9030-4cf7-88a0-1ad789eec1bd on user Apr 14 17:07:47 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-844efca3-25bc-4136-a871-40bd4bddccad req-3ef0866c-4b77-4522-87ff-01f308239e31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043646 Apr 14 17:07:47 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 96/286] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:49 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-3dc2981d-7936-4127-8716-92b2f107b663 req-02929108-97b8-40e6-ac21-c006d41767e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5920661-9030-4cf7-88a0-1ad789eec1bd", "name": "network-vif-plugged", "status": "completed", "tag": "526282d7-c5ce-4ae0-9745-4e43477222f0"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:49 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:07:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3dc2981d-7936-4127-8716-92b2f107b663 req-02929108-97b8-40e6-ac21-c006d41767e5 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3dc2981d-7936-4127-8716-92b2f107b663 req-02929108-97b8-40e6-ac21-c006d41767e5 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3dc2981d-7936-4127-8716-92b2f107b663 req-02929108-97b8-40e6-ac21-c006d41767e5 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:49 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:07:49 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-3dc2981d-7936-4127-8716-92b2f107b663 req-02929108-97b8-40e6-ac21-c006d41767e5 service nova] Creating event network-vif-plugged:526282d7-c5ce-4ae0-9745-4e43477222f0 for instance d5920661-9030-4cf7-88a0-1ad789eec1bd on user Apr 14 17:07:49 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-3dc2981d-7936-4127-8716-92b2f107b663 req-02929108-97b8-40e6-ac21-c006d41767e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081130 Apr 14 17:07:49 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 97/287] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:49 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-181691319", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "networks": [{"uuid": "d6985162-5d80-43b0-a99f-e724ada7fdf4"}]}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:49 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:07:49 user devstack@n-api.service[61934]: DEBUG nova.network.neutron [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] validate_networks() for [('d6985162-5d80-43b0-a99f-e724ada7fdf4', None, None, None, None, None)] {{(pid=61934) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:07:50 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:07:50 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:07:50 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:07:50 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:07:50 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:07:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:50 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:07:50 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Getting quotas for project 965bd22f61df40bd89e8ef35fb12bcd3. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:07:50 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Getting quotas for user b5c86125160643958349100fb3a7855b and project 965bd22f61df40bd89e8ef35fb12bcd3. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:07:50 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Going to run 1 instances... {{(pid=61934) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:07:50 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:07:50 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-0bc98e24-fca3-47dc-9167-cc682a094002 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.735942 Apr 14 17:07:50 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 95/288] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 17:07:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 17:07:50 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d8d645dc-4178-46cb-8e0d-63c865f1f5be tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:50 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-d8d645dc-4178-46cb-8e0d-63c865f1f5be tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:50 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=26 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:07:50 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-d8d645dc-4178-46cb-8e0d-63c865f1f5be tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:50 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-d8d645dc-4178-46cb-8e0d-63c865f1f5be tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:50 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-d8d645dc-4178-46cb-8e0d-63c865f1f5be tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:50 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d8d645dc-4178-46cb-8e0d-63c865f1f5be tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" status: 200 len: 1394 microversion: 2.87 time: 0.092082 Apr 14 17:07:50 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 97/289] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:07:50 2023] GET /compute/v2.1/servers/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f => generated 1394 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:07:51 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a688894b-daea-4e47-84a5-d95c886ff308 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:51 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-a688894b-daea-4e47-84a5-d95c886ff308 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a688894b-daea-4e47-84a5-d95c886ff308 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a688894b-daea-4e47-84a5-d95c886ff308 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a688894b-daea-4e47-84a5-d95c886ff308 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a688894b-daea-4e47-84a5-d95c886ff308 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a688894b-daea-4e47-84a5-d95c886ff308 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a688894b-daea-4e47-84a5-d95c886ff308 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:51 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-a688894b-daea-4e47-84a5-d95c886ff308 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] HTTP exception thrown: Instance 113dda5c-a61e-423b-86ea-2fe30a113173 could not be found. Apr 14 17:07:51 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a688894b-daea-4e47-84a5-d95c886ff308 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Request method failure captured: Apr 14 17:07:51 user devstack@n-api.service[61935]: request: GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173 HTTP/1.1 Apr 14 17:07:51 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:07:51 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:07:51 user devstack@n-api.service[61935]: Connection: close Apr 14 17:07:51 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:07:51 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:07:51 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:07:51 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:07:51 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:07:51 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYdfsoOj1LDqSQzAJxiYzwWsEkx3EVUhDRRF-FIdWp9TVepL4T5PykLI0wMEynYozJ8uQmHA0K22_ejfvAWNTRZE1loygShBsgBmok3ug6Ku9AdBYdfnIdVtNSLx-uX7yETZgQKpVUvtJKFddbDdLldlzPAUq5G-kaylnn4Ivw7Py6Q Apr 14 17:07:51 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:07:51 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:07:51 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:07:51 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:07:51 user devstack@n-api.service[61935]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 17:07:51 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:07:51 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:07:51 user devstack@n-api.service[61935]: X-Project-Id: 924256f7ef8c4a5a832a87d1c198c50a Apr 14 17:07:51 user devstack@n-api.service[61935]: X-Project-Name: tempest-TaggedAttachmentsTest-1726748799 Apr 14 17:07:51 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:07:51 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:07:51 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/924256f7ef8c4a5a832a87d1c198c50a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/924256f7ef8c4a5a832a87d1c198c50a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/924256f7ef8c4a5a832a87d1c198c50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:07:51 user devstack@n-api.service[61935]: X-Tenant: tempest-TaggedAttachmentsTest-1726748799 Apr 14 17:07:51 user devstack@n-api.service[61935]: X-Tenant-Id: 924256f7ef8c4a5a832a87d1c198c50a Apr 14 17:07:51 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1726748799 Apr 14 17:07:51 user devstack@n-api.service[61935]: X-User: tempest-TaggedAttachmentsTest-1726748799-project-member Apr 14 17:07:51 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:07:51 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:07:51 user devstack@n-api.service[61935]: X-User-Id: c31588acbcc345519934f4c3a395b0c5 Apr 14 17:07:51 user devstack@n-api.service[61935]: X-User-Name: tempest-TaggedAttachmentsTest-1726748799-project-member Apr 14 17:07:51 user devstack@n-api.service[61935]: method: > Apr 14 17:07:51 user devstack@n-api.service[61935]: exception: Instance 113dda5c-a61e-423b-86ea-2fe30a113173 could not be found. Apr 14 17:07:51 user devstack@n-api.service[61935]: action_args: {'id': '113dda5c-a61e-423b-86ea-2fe30a113173'} Apr 14 17:07:51 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 113dda5c-a61e-423b-86ea-2fe30a113173 could not be found. Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 113dda5c-a61e-423b-86ea-2fe30a113173 could not be found. Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 113dda5c-a61e-423b-86ea-2fe30a113173 could not be found. Apr 14 17:07:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:07:51 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a688894b-daea-4e47-84a5-d95c886ff308 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Returning 404 to user: Instance 113dda5c-a61e-423b-86ea-2fe30a113173 could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:07:51 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-a688894b-daea-4e47-84a5-d95c886ff308 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] 10.0.0.210 "GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173" status: 404 len: 111 microversion: 2.49 time: 0.043912 Apr 14 17:07:51 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 98/290] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:07:51 2023] GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:07:51 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-972a2e77-727a-4db7-a658-1283e6b56915 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Calling method '.version_select at 0x7fe19d0fb7f0>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:51 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-972a2e77-727a-4db7-a658-1283e6b56915 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-692507657" status: 204 len: 0 microversion: 2.49 time: 0.028155 Apr 14 17:07:51 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 96/291] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 17:07:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-692507657 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 17:07:53 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-ea3769c3-1609-4894-9324-65cf041ca34d req-7dc195c8-3354-4793-bed5-003eedda782d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f", "tag": "4ca35158-a3a3-41be-bfea-28f8bf46a796"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:53 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ea3769c3-1609-4894-9324-65cf041ca34d req-7dc195c8-3354-4793-bed5-003eedda782d service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:53 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ea3769c3-1609-4894-9324-65cf041ca34d req-7dc195c8-3354-4793-bed5-003eedda782d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:53 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ea3769c3-1609-4894-9324-65cf041ca34d req-7dc195c8-3354-4793-bed5-003eedda782d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:53 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-ea3769c3-1609-4894-9324-65cf041ca34d req-7dc195c8-3354-4793-bed5-003eedda782d service nova] Creating event network-changed:4ca35158-a3a3-41be-bfea-28f8bf46a796 for instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f on user Apr 14 17:07:53 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-ea3769c3-1609-4894-9324-65cf041ca34d req-7dc195c8-3354-4793-bed5-003eedda782d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034444 Apr 14 17:07:53 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 98/292] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:53 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-3d047f2b-98e7-4db8-b3a2-f530728ee254 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:53 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-3d047f2b-98e7-4db8-b3a2-f530728ee254 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3d047f2b-98e7-4db8-b3a2-f530728ee254 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3d047f2b-98e7-4db8-b3a2-f530728ee254 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3d047f2b-98e7-4db8-b3a2-f530728ee254 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3d047f2b-98e7-4db8-b3a2-f530728ee254 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3d047f2b-98e7-4db8-b3a2-f530728ee254 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3d047f2b-98e7-4db8-b3a2-f530728ee254 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:53 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-3d047f2b-98e7-4db8-b3a2-f530728ee254 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] HTTP exception thrown: Instance 113dda5c-a61e-423b-86ea-2fe30a113173 could not be found. Apr 14 17:07:53 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-3d047f2b-98e7-4db8-b3a2-f530728ee254 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Request method failure captured: Apr 14 17:07:53 user devstack@n-api.service[61935]: request: DELETE /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173 HTTP/1.1 Apr 14 17:07:53 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:07:53 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:07:53 user devstack@n-api.service[61935]: Connection: close Apr 14 17:07:53 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:07:53 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:07:53 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:07:53 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:07:53 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:07:53 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYdfsoOj1LDqSQzAJxiYzwWsEkx3EVUhDRRF-FIdWp9TVepL4T5PykLI0wMEynYozJ8uQmHA0K22_ejfvAWNTRZE1loygShBsgBmok3ug6Ku9AdBYdfnIdVtNSLx-uX7yETZgQKpVUvtJKFddbDdLldlzPAUq5G-kaylnn4Ivw7Py6Q Apr 14 17:07:53 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:07:53 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:07:53 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:07:53 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:07:53 user devstack@n-api.service[61935]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 17:07:53 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:07:53 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:07:53 user devstack@n-api.service[61935]: X-Project-Id: 924256f7ef8c4a5a832a87d1c198c50a Apr 14 17:07:53 user devstack@n-api.service[61935]: X-Project-Name: tempest-TaggedAttachmentsTest-1726748799 Apr 14 17:07:53 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:07:53 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:07:53 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/924256f7ef8c4a5a832a87d1c198c50a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/924256f7ef8c4a5a832a87d1c198c50a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/924256f7ef8c4a5a832a87d1c198c50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:07:53 user devstack@n-api.service[61935]: X-Tenant: tempest-TaggedAttachmentsTest-1726748799 Apr 14 17:07:53 user devstack@n-api.service[61935]: X-Tenant-Id: 924256f7ef8c4a5a832a87d1c198c50a Apr 14 17:07:53 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1726748799 Apr 14 17:07:53 user devstack@n-api.service[61935]: X-User: tempest-TaggedAttachmentsTest-1726748799-project-member Apr 14 17:07:53 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:07:53 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:07:53 user devstack@n-api.service[61935]: X-User-Id: c31588acbcc345519934f4c3a395b0c5 Apr 14 17:07:53 user devstack@n-api.service[61935]: X-User-Name: tempest-TaggedAttachmentsTest-1726748799-project-member Apr 14 17:07:53 user devstack@n-api.service[61935]: method: > Apr 14 17:07:53 user devstack@n-api.service[61935]: exception: Instance 113dda5c-a61e-423b-86ea-2fe30a113173 could not be found. Apr 14 17:07:53 user devstack@n-api.service[61935]: action_args: {'id': '113dda5c-a61e-423b-86ea-2fe30a113173'} Apr 14 17:07:53 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 113dda5c-a61e-423b-86ea-2fe30a113173 could not be found. Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 113dda5c-a61e-423b-86ea-2fe30a113173 could not be found. Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 113dda5c-a61e-423b-86ea-2fe30a113173 could not be found. Apr 14 17:07:53 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:07:53 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-3d047f2b-98e7-4db8-b3a2-f530728ee254 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Returning 404 to user: Instance 113dda5c-a61e-423b-86ea-2fe30a113173 could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:07:53 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-3d047f2b-98e7-4db8-b3a2-f530728ee254 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173" status: 404 len: 111 microversion: 2.49 time: 0.035164 Apr 14 17:07:53 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 99/293] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 17:07:53 2023] DELETE /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:07:53 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-3c5b00a1-8beb-414b-acda-acd132c42ba7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:53 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-3c5b00a1-8beb-414b-acda-acd132c42ba7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] [instance: 113dda5c-a61e-423b-86ea-2fe30a113173] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3c5b00a1-8beb-414b-acda-acd132c42ba7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3c5b00a1-8beb-414b-acda-acd132c42ba7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3c5b00a1-8beb-414b-acda-acd132c42ba7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3c5b00a1-8beb-414b-acda-acd132c42ba7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3c5b00a1-8beb-414b-acda-acd132c42ba7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3c5b00a1-8beb-414b-acda-acd132c42ba7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:53 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-3c5b00a1-8beb-414b-acda-acd132c42ba7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] HTTP exception thrown: Instance 113dda5c-a61e-423b-86ea-2fe30a113173 could not be found. Apr 14 17:07:53 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-3c5b00a1-8beb-414b-acda-acd132c42ba7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Request method failure captured: Apr 14 17:07:53 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173 HTTP/1.1 Apr 14 17:07:53 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:07:53 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:07:53 user devstack@n-api.service[61934]: Connection: close Apr 14 17:07:53 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:07:53 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:07:53 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:07:53 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:07:53 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:07:53 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYdfsoOj1LDqSQzAJxiYzwWsEkx3EVUhDRRF-FIdWp9TVepL4T5PykLI0wMEynYozJ8uQmHA0K22_ejfvAWNTRZE1loygShBsgBmok3ug6Ku9AdBYdfnIdVtNSLx-uX7yETZgQKpVUvtJKFddbDdLldlzPAUq5G-kaylnn4Ivw7Py6Q Apr 14 17:07:53 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:07:53 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:07:53 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:07:53 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:07:53 user devstack@n-api.service[61934]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 17:07:53 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:07:53 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:07:53 user devstack@n-api.service[61934]: X-Project-Id: 924256f7ef8c4a5a832a87d1c198c50a Apr 14 17:07:53 user devstack@n-api.service[61934]: X-Project-Name: tempest-TaggedAttachmentsTest-1726748799 Apr 14 17:07:53 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:07:53 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:07:53 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/924256f7ef8c4a5a832a87d1c198c50a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/924256f7ef8c4a5a832a87d1c198c50a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/924256f7ef8c4a5a832a87d1c198c50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:07:53 user devstack@n-api.service[61934]: X-Tenant: tempest-TaggedAttachmentsTest-1726748799 Apr 14 17:07:53 user devstack@n-api.service[61934]: X-Tenant-Id: 924256f7ef8c4a5a832a87d1c198c50a Apr 14 17:07:53 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1726748799 Apr 14 17:07:53 user devstack@n-api.service[61934]: X-User: tempest-TaggedAttachmentsTest-1726748799-project-member Apr 14 17:07:53 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:07:53 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:07:53 user devstack@n-api.service[61934]: X-User-Id: c31588acbcc345519934f4c3a395b0c5 Apr 14 17:07:53 user devstack@n-api.service[61934]: X-User-Name: tempest-TaggedAttachmentsTest-1726748799-project-member Apr 14 17:07:53 user devstack@n-api.service[61934]: method: > Apr 14 17:07:53 user devstack@n-api.service[61934]: exception: Instance 113dda5c-a61e-423b-86ea-2fe30a113173 could not be found. Apr 14 17:07:53 user devstack@n-api.service[61934]: action_args: {'id': '113dda5c-a61e-423b-86ea-2fe30a113173'} Apr 14 17:07:53 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 113dda5c-a61e-423b-86ea-2fe30a113173 could not be found. Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 113dda5c-a61e-423b-86ea-2fe30a113173 could not be found. Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 113dda5c-a61e-423b-86ea-2fe30a113173 could not be found. Apr 14 17:07:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:07:53 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-3c5b00a1-8beb-414b-acda-acd132c42ba7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] Returning 404 to user: Instance 113dda5c-a61e-423b-86ea-2fe30a113173 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:07:53 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-3c5b00a1-8beb-414b-acda-acd132c42ba7 tempest-TaggedAttachmentsTest-1726748799 tempest-TaggedAttachmentsTest-1726748799-project-member] 10.0.0.210 "GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173" status: 404 len: 111 microversion: 2.49 time: 0.044463 Apr 14 17:07:53 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 97/294] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:07:53 2023] GET /compute/v2.1/servers/113dda5c-a61e-423b-86ea-2fe30a113173 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:07:55 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-1b1698ab-2e5b-4c8f-9334-a2bfd84ad3f7 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:07:55 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-1b1698ab-2e5b-4c8f-9334-a2bfd84ad3f7 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:07:55 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1b1698ab-2e5b-4c8f-9334-a2bfd84ad3f7 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:55 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1b1698ab-2e5b-4c8f-9334-a2bfd84ad3f7 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:55 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1b1698ab-2e5b-4c8f-9334-a2bfd84ad3f7 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:55 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1b1698ab-2e5b-4c8f-9334-a2bfd84ad3f7 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:55 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1b1698ab-2e5b-4c8f-9334-a2bfd84ad3f7 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:55 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1b1698ab-2e5b-4c8f-9334-a2bfd84ad3f7 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:55 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-2c417211-c372-4a55-94b0-16f6bd6d824a req-9372144a-d92a-417c-99d3-e10d8007be08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f", "name": "network-vif-plugged", "status": "completed", "tag": "4ca35158-a3a3-41be-bfea-28f8bf46a796"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2c417211-c372-4a55-94b0-16f6bd6d824a req-9372144a-d92a-417c-99d3-e10d8007be08 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2c417211-c372-4a55-94b0-16f6bd6d824a req-9372144a-d92a-417c-99d3-e10d8007be08 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2c417211-c372-4a55-94b0-16f6bd6d824a req-9372144a-d92a-417c-99d3-e10d8007be08 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:55 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-2c417211-c372-4a55-94b0-16f6bd6d824a req-9372144a-d92a-417c-99d3-e10d8007be08 service nova] Creating event network-vif-plugged:4ca35158-a3a3-41be-bfea-28f8bf46a796 for instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f on user Apr 14 17:07:55 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-2c417211-c372-4a55-94b0-16f6bd6d824a req-9372144a-d92a-417c-99d3-e10d8007be08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061072 Apr 14 17:07:55 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 100/295] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:07:55 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-1b1698ab-2e5b-4c8f-9334-a2bfd84ad3f7 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef6f58f76314333b233365266ef5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447e75d0cc144b9ab741d8591af3959e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:55 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-1b1698ab-2e5b-4c8f-9334-a2bfd84ad3f7 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eef6f58f76314333b233365266ef5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447e75d0cc144b9ab741d8591af3959e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:55 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-1b1698ab-2e5b-4c8f-9334-a2bfd84ad3f7 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eef6f58f76314333b233365266ef5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447e75d0cc144b9ab741d8591af3959e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:07:55 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-1b1698ab-2e5b-4c8f-9334-a2bfd84ad3f7 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb" status: 200 len: 2827 microversion: 2.42 time: 0.706216 Apr 14 17:07:55 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 99/296] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:07:55 2023] GET /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb => generated 2827 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 17:07:57 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-5510337f-ec46-4e98-be13-ae7af458113b req-0b4f982b-c182-4bdd-8bff-19e88bd47d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f", "name": "network-vif-plugged", "status": "completed", "tag": "4ca35158-a3a3-41be-bfea-28f8bf46a796"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:07:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5510337f-ec46-4e98-be13-ae7af458113b req-0b4f982b-c182-4bdd-8bff-19e88bd47d6f service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:07:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5510337f-ec46-4e98-be13-ae7af458113b req-0b4f982b-c182-4bdd-8bff-19e88bd47d6f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:07:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5510337f-ec46-4e98-be13-ae7af458113b req-0b4f982b-c182-4bdd-8bff-19e88bd47d6f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:07:57 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-5510337f-ec46-4e98-be13-ae7af458113b req-0b4f982b-c182-4bdd-8bff-19e88bd47d6f service nova] Creating event network-vif-plugged:4ca35158-a3a3-41be-bfea-28f8bf46a796 for instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f on user Apr 14 17:07:57 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-5510337f-ec46-4e98-be13-ae7af458113b req-0b4f982b-c182-4bdd-8bff-19e88bd47d6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047947 Apr 14 17:07:57 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 98/297] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:07:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:08:02 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-d11aa293-6f21-48e4-abf8-6a52ccdbdacd tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:02 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-d11aa293-6f21-48e4-abf8-6a52ccdbdacd tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d11aa293-6f21-48e4-abf8-6a52ccdbdacd tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d11aa293-6f21-48e4-abf8-6a52ccdbdacd tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d11aa293-6f21-48e4-abf8-6a52ccdbdacd tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d11aa293-6f21-48e4-abf8-6a52ccdbdacd tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d11aa293-6f21-48e4-abf8-6a52ccdbdacd tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d11aa293-6f21-48e4-abf8-6a52ccdbdacd tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-d11aa293-6f21-48e4-abf8-6a52ccdbdacd tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] HTTP exception thrown: Instance 7465a41f-c916-4cca-8084-7c646409007d could not be found. Apr 14 17:08:02 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-d11aa293-6f21-48e4-abf8-6a52ccdbdacd tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Request method failure captured: Apr 14 17:08:02 user devstack@n-api.service[61935]: request: GET /compute/v2.1/servers/7465a41f-c916-4cca-8084-7c646409007d HTTP/1.1 Apr 14 17:08:02 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:08:02 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:08:02 user devstack@n-api.service[61935]: Connection: close Apr 14 17:08:02 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:08:02 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:08:02 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:08:02 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:08:02 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:08:02 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYdeer58jEvUR9ADIlb0N430T-Ds21-KcdHVVoui-D_EAL5w5NtUAiByINleZljOdamOoVfvloz9qBpRKJNkBB-q3J2hMItuCYI1rvO5iZ-gzcRL6EYmrivLdXp9j61AUeL3LT7o_QloEQzxw1RchmjWXo1xX65gA6Tz8oI3QnBXw6g Apr 14 17:08:02 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:08:02 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:08:02 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:08:02 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:08:02 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:08:02 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:08:02 user devstack@n-api.service[61935]: X-Project-Id: 426156fb00db428683851cf731b680d1 Apr 14 17:08:02 user devstack@n-api.service[61935]: X-Project-Name: tempest-ServersNegativeTestJSON-1832599821 Apr 14 17:08:02 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:08:02 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:08:02 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426156fb00db428683851cf731b680d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426156fb00db428683851cf731b680d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/426156fb00db428683851cf731b680d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:08:02 user devstack@n-api.service[61935]: X-Tenant: tempest-ServersNegativeTestJSON-1832599821 Apr 14 17:08:02 user devstack@n-api.service[61935]: X-Tenant-Id: 426156fb00db428683851cf731b680d1 Apr 14 17:08:02 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832599821 Apr 14 17:08:02 user devstack@n-api.service[61935]: X-User: tempest-ServersNegativeTestJSON-1832599821-project-member Apr 14 17:08:02 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:08:02 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:08:02 user devstack@n-api.service[61935]: X-User-Id: 0d1ea0218b044c1e94f61a07c1d14a75 Apr 14 17:08:02 user devstack@n-api.service[61935]: X-User-Name: tempest-ServersNegativeTestJSON-1832599821-project-member Apr 14 17:08:02 user devstack@n-api.service[61935]: method: > Apr 14 17:08:02 user devstack@n-api.service[61935]: exception: Instance 7465a41f-c916-4cca-8084-7c646409007d could not be found. Apr 14 17:08:02 user devstack@n-api.service[61935]: action_args: {'id': '7465a41f-c916-4cca-8084-7c646409007d'} Apr 14 17:08:02 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7465a41f-c916-4cca-8084-7c646409007d could not be found. Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7465a41f-c916-4cca-8084-7c646409007d could not be found. Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7465a41f-c916-4cca-8084-7c646409007d could not be found. Apr 14 17:08:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:08:02 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-d11aa293-6f21-48e4-abf8-6a52ccdbdacd tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Returning 404 to user: Instance 7465a41f-c916-4cca-8084-7c646409007d could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:08:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-d11aa293-6f21-48e4-abf8-6a52ccdbdacd tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7465a41f-c916-4cca-8084-7c646409007d" status: 404 len: 111 microversion: 2.1 time: 0.032521 Apr 14 17:08:02 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 101/298] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:08:02 2023] GET /compute/v2.1/servers/7465a41f-c916-4cca-8084-7c646409007d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:08:02 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:02 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-5c1e9e87-196b-4375-9c9e-0bf998189d9c tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:02 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-5c1e9e87-196b-4375-9c9e-0bf998189d9c tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5c1e9e87-196b-4375-9c9e-0bf998189d9c tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5c1e9e87-196b-4375-9c9e-0bf998189d9c tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5c1e9e87-196b-4375-9c9e-0bf998189d9c tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5c1e9e87-196b-4375-9c9e-0bf998189d9c tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5c1e9e87-196b-4375-9c9e-0bf998189d9c tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5c1e9e87-196b-4375-9c9e-0bf998189d9c tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:02 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-5c1e9e87-196b-4375-9c9e-0bf998189d9c tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1ea0218b044c1e94f61a07c1d14a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426156fb00db428683851cf731b680d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:08:02 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-5c1e9e87-196b-4375-9c9e-0bf998189d9c tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d" status: 200 len: 1492 microversion: 2.1 time: 0.348141 Apr 14 17:08:02 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 100/299] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:08:02 2023] GET /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d => generated 1492 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:08:09 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:09 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:09 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:09 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=5 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:09 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-087fc149-0070-49fa-b83c-a495fc25fbae tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:09 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-087fc149-0070-49fa-b83c-a495fc25fbae tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] [instance: f53cfe1f-c915-4a74-8512-84a97147f1d1] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-087fc149-0070-49fa-b83c-a495fc25fbae tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-087fc149-0070-49fa-b83c-a495fc25fbae tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-087fc149-0070-49fa-b83c-a495fc25fbae tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-087fc149-0070-49fa-b83c-a495fc25fbae tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-087fc149-0070-49fa-b83c-a495fc25fbae tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-087fc149-0070-49fa-b83c-a495fc25fbae tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:09 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-087fc149-0070-49fa-b83c-a495fc25fbae tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] HTTP exception thrown: Instance f53cfe1f-c915-4a74-8512-84a97147f1d1 could not be found. Apr 14 17:08:09 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-087fc149-0070-49fa-b83c-a495fc25fbae tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Request method failure captured: Apr 14 17:08:09 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1 HTTP/1.1 Apr 14 17:08:09 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:08:09 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:08:09 user devstack@n-api.service[61934]: Connection: close Apr 14 17:08:09 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:08:09 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:08:09 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:08:09 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:08:09 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:08:09 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYdcGStEvm-gvos8SOcJAP7ZC0N8krvym84UssS-NyBvEB1k7N4FPfoT3qyZ4d7o5Z0Diitu72YoJjmjsIzm9d0822iME503rECNKOO50w-0eooWRKQLFGL1bJv0JUa9oBRB0-mjYAsaHIDKVPVZc9UogrY2F9BUMWjZCCCc8j6cIfE Apr 14 17:08:09 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:08:09 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:08:09 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:08:09 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:08:09 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:08:09 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:08:09 user devstack@n-api.service[61934]: X-Project-Id: e21607283fae4bd0a679948ea8fa4881 Apr 14 17:08:09 user devstack@n-api.service[61934]: X-Project-Name: tempest-TestVolumeSwap-1289119351 Apr 14 17:08:09 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:08:09 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:08:09 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e21607283fae4bd0a679948ea8fa4881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e21607283fae4bd0a679948ea8fa4881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e21607283fae4bd0a679948ea8fa4881"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:08:09 user devstack@n-api.service[61934]: X-Tenant: tempest-TestVolumeSwap-1289119351 Apr 14 17:08:09 user devstack@n-api.service[61934]: X-Tenant-Id: e21607283fae4bd0a679948ea8fa4881 Apr 14 17:08:09 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-TestVolumeSwap-1289119351 Apr 14 17:08:09 user devstack@n-api.service[61934]: X-User: tempest-TestVolumeSwap-1289119351-project-member Apr 14 17:08:09 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:08:09 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:08:09 user devstack@n-api.service[61934]: X-User-Id: d79ebfd1410c4ffda69bc3bfaebbc25d Apr 14 17:08:09 user devstack@n-api.service[61934]: X-User-Name: tempest-TestVolumeSwap-1289119351-project-member Apr 14 17:08:09 user devstack@n-api.service[61934]: method: > Apr 14 17:08:09 user devstack@n-api.service[61934]: exception: Instance f53cfe1f-c915-4a74-8512-84a97147f1d1 could not be found. Apr 14 17:08:09 user devstack@n-api.service[61934]: action_args: {'id': 'f53cfe1f-c915-4a74-8512-84a97147f1d1'} Apr 14 17:08:09 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f53cfe1f-c915-4a74-8512-84a97147f1d1 could not be found. Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f53cfe1f-c915-4a74-8512-84a97147f1d1 could not be found. Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f53cfe1f-c915-4a74-8512-84a97147f1d1 could not be found. Apr 14 17:08:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:08:09 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-087fc149-0070-49fa-b83c-a495fc25fbae tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Returning 404 to user: Instance f53cfe1f-c915-4a74-8512-84a97147f1d1 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:08:09 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-087fc149-0070-49fa-b83c-a495fc25fbae tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1" status: 404 len: 111 microversion: 2.1 time: 0.132505 Apr 14 17:08:09 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 99/300] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:08:09 2023] GET /compute/v2.1/servers/f53cfe1f-c915-4a74-8512-84a97147f1d1 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:08:09 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-2f1e59d1-d619-4e47-8258-7e5a34c313f9 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] Calling method '.version_select at 0x7fe19cf59c60>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:09 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-2f1e59d1-d619-4e47-8258-7e5a34c313f9 tempest-TestVolumeSwap-1289119351 tempest-TestVolumeSwap-1289119351-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1178292474" status: 202 len: 0 microversion: 2.1 time: 0.025221 Apr 14 17:08:09 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 102/301] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 17:08:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1178292474 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:08:13 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=11 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:13 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=15 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:13 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-04d5f812-4deb-4e6d-8933-9b9c8b101137 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Action: 'create', calling method: .version_select at 0x7fe19cf00b80>, body: {"keypair": {"name": "tempest-keypair-310941958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKw1AoJDBWAH2SgQpvVdE5HczN/H8Nls1QyNcsxVgax5kh+80bPggB6BCe94JDyCYI44XQF2u92maqDLMw95xWPl6YM1AjodAlJbBcNGWd8/CIaHD34OL7RhWiwMdTIUg=="}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:08:13 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-04d5f812-4deb-4e6d-8933-9b9c8b101137 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting quotas for project 978cd1b4b6434b298731b01dac02591c. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:08:13 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-04d5f812-4deb-4e6d-8933-9b9c8b101137 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting quotas for user a22398c18fcc48aca2f0f9691f1c1143 and project 978cd1b4b6434b298731b01dac02591c. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:08:13 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-04d5f812-4deb-4e6d-8933-9b9c8b101137 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.224775 Apr 14 17:08:13 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 101/302] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 17:08:13 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:08:14 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-253960403", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d"}], "security_groups": [{"name": "tempest-securitygroup--1580043032"}], "key_name": "tempest-keypair-310941958", "user_data": "}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:08:14 user devstack@n-api.service[61934]: DEBUG nova.network.neutron [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] validate_networks() for [('187c0a7b-9043-4eac-8ad7-2c72b6f23d4d', None, None, None, None, None)] {{(pid=61934) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:08:15 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:08:15 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:08:15 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:08:15 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:08:15 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:08:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:15 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting quotas for project 978cd1b4b6434b298731b01dac02591c. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:08:15 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting quotas for user a22398c18fcc48aca2f0f9691f1c1143 and project 978cd1b4b6434b298731b01dac02591c. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:08:15 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Going to run 1 instances... {{(pid=61934) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:08:15 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:08:15 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-8892544e-4e16-4f7c-ba94-33a4054c6f8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.716486 Apr 14 17:08:15 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 100/303] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:08:14 2023] POST /compute/v2.1/servers => generated 407 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:08:15 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=9 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:15 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-97477a0d-9406-4e6b-945b-3f6a930778e2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:15 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-97477a0d-9406-4e6b-945b-3f6a930778e2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:15 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-97477a0d-9406-4e6b-945b-3f6a930778e2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:08:15 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-97477a0d-9406-4e6b-945b-3f6a930778e2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1231 microversion: 2.1 time: 0.064873 Apr 14 17:08:15 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 103/304] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:08:15 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1231 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:08:16 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-888b786c-1172-49b8-a667-03a8d4334546 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:16 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-888b786c-1172-49b8-a667-03a8d4334546 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-888b786c-1172-49b8-a667-03a8d4334546 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-888b786c-1172-49b8-a667-03a8d4334546 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-888b786c-1172-49b8-a667-03a8d4334546 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-888b786c-1172-49b8-a667-03a8d4334546 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-888b786c-1172-49b8-a667-03a8d4334546 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-888b786c-1172-49b8-a667-03a8d4334546 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:17 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-888b786c-1172-49b8-a667-03a8d4334546 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c4734925f645248b0f9060aa78a502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8f6b39515e456c9f5a1affa9f79000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:08:17 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-888b786c-1172-49b8-a667-03a8d4334546 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97" status: 200 len: 1700 microversion: 2.1 time: 0.984603 Apr 14 17:08:17 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 102/305] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:08:16 2023] GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97 => generated 1700 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:08:19 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-1a48bfe5-8b4a-4ae0-b0e4-07916d0613ff req-8365676a-e406-4c09-90ac-d031ed1f5c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "tag": "de268504-352a-4d08-8113-a2098b794478"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:08:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-1a48bfe5-8b4a-4ae0-b0e4-07916d0613ff req-8365676a-e406-4c09-90ac-d031ed1f5c60 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-1a48bfe5-8b4a-4ae0-b0e4-07916d0613ff req-8365676a-e406-4c09-90ac-d031ed1f5c60 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-1a48bfe5-8b4a-4ae0-b0e4-07916d0613ff req-8365676a-e406-4c09-90ac-d031ed1f5c60 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:19 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-1a48bfe5-8b4a-4ae0-b0e4-07916d0613ff req-8365676a-e406-4c09-90ac-d031ed1f5c60 service nova] Creating event network-changed:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:08:19 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-1a48bfe5-8b4a-4ae0-b0e4-07916d0613ff req-8365676a-e406-4c09-90ac-d031ed1f5c60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038754 Apr 14 17:08:19 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 101/306] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:08:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:08:21 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-0232cff2-4a08-4345-8d35-f08631858be8 req-f4ac708f-a3e0-4e29-aa89-02abc158502e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "name": "network-vif-plugged", "status": "completed", "tag": "de268504-352a-4d08-8113-a2098b794478"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:08:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-0232cff2-4a08-4345-8d35-f08631858be8 req-f4ac708f-a3e0-4e29-aa89-02abc158502e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-0232cff2-4a08-4345-8d35-f08631858be8 req-f4ac708f-a3e0-4e29-aa89-02abc158502e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-0232cff2-4a08-4345-8d35-f08631858be8 req-f4ac708f-a3e0-4e29-aa89-02abc158502e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:21 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-0232cff2-4a08-4345-8d35-f08631858be8 req-f4ac708f-a3e0-4e29-aa89-02abc158502e service nova] Creating event network-vif-plugged:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:08:21 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-0232cff2-4a08-4345-8d35-f08631858be8 req-f4ac708f-a3e0-4e29-aa89-02abc158502e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043606 Apr 14 17:08:21 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 104/307] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:08:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:08:22 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-4fa7b2fa-2950-45c2-92bd-a8c7fb75b6ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:22 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-4fa7b2fa-2950-45c2-92bd-a8c7fb75b6ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4fa7b2fa-2950-45c2-92bd-a8c7fb75b6ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4fa7b2fa-2950-45c2-92bd-a8c7fb75b6ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4fa7b2fa-2950-45c2-92bd-a8c7fb75b6ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4fa7b2fa-2950-45c2-92bd-a8c7fb75b6ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4fa7b2fa-2950-45c2-92bd-a8c7fb75b6ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4fa7b2fa-2950-45c2-92bd-a8c7fb75b6ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:22 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-4fa7b2fa-2950-45c2-92bd-a8c7fb75b6ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] HTTP exception thrown: Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd could not be found. Apr 14 17:08:22 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-4fa7b2fa-2950-45c2-92bd-a8c7fb75b6ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Request method failure captured: Apr 14 17:08:22 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd HTTP/1.1 Apr 14 17:08:22 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:08:22 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:08:22 user devstack@n-api.service[61933]: Connection: close Apr 14 17:08:22 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:08:22 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:08:22 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:08:22 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:08:22 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:08:22 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYdYtBTMjEs6wq_AX7uLwl48FezTrz7FyW6CSVOm9G6i0ttgahwJf1S74Fss_9qd0JO9t5wr7pQDv25cSrw7tI0XNOdCBZPRJQlF-w0w2Xn2ZRZ5EUArK2xGuE0HglaJJpHNyoLBzYQsp9Av8_ba24psGn8qYzpzCLzlLWiMZvDXQQQ Apr 14 17:08:22 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:08:22 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:08:22 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:08:22 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:08:22 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:08:22 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:08:22 user devstack@n-api.service[61933]: X-Project-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:08:22 user devstack@n-api.service[61933]: X-Project-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:08:22 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:08:22 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:08:22 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6f341a2096b9483787b569a59f325556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:08:22 user devstack@n-api.service[61933]: X-Tenant: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:08:22 user devstack@n-api.service[61933]: X-Tenant-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:08:22 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:08:22 user devstack@n-api.service[61933]: X-User: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:08:22 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:08:22 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:08:22 user devstack@n-api.service[61933]: X-User-Id: d9c9e0d318eb4ca49d47d620682fb00a Apr 14 17:08:22 user devstack@n-api.service[61933]: X-User-Name: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:08:22 user devstack@n-api.service[61933]: method: > Apr 14 17:08:22 user devstack@n-api.service[61933]: exception: Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd could not be found. Apr 14 17:08:22 user devstack@n-api.service[61933]: action_args: {'id': '3469a45b-e63a-4871-a6c5-deece7f4ecfd'} Apr 14 17:08:22 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd could not be found. Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd could not be found. Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd could not be found. Apr 14 17:08:22 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:08:22 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-4fa7b2fa-2950-45c2-92bd-a8c7fb75b6ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Returning 404 to user: Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:08:22 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-4fa7b2fa-2950-45c2-92bd-a8c7fb75b6ea tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd" status: 404 len: 111 microversion: 2.1 time: 0.186468 Apr 14 17:08:22 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 103/308] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:08:22 2023] GET /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:08:22 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-f0ca1d0a-568b-405f-9ed5-da9b187c4fb8 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '.version_select at 0x7fe19d0fb400>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:22 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-f0ca1d0a-568b-405f-9ed5-da9b187c4fb8 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-122500492" status: 202 len: 0 microversion: 2.1 time: 0.023715 Apr 14 17:08:22 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 102/309] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 17:08:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-122500492 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:08:23 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-f46e8b66-ad3b-4083-800c-92b6f975d44c req-ee5ccbf5-2406-41dc-bb36-d05543e3ee5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "name": "network-vif-plugged", "status": "completed", "tag": "de268504-352a-4d08-8113-a2098b794478"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:08:23 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-f46e8b66-ad3b-4083-800c-92b6f975d44c req-ee5ccbf5-2406-41dc-bb36-d05543e3ee5b service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-f46e8b66-ad3b-4083-800c-92b6f975d44c req-ee5ccbf5-2406-41dc-bb36-d05543e3ee5b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-f46e8b66-ad3b-4083-800c-92b6f975d44c req-ee5ccbf5-2406-41dc-bb36-d05543e3ee5b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:23 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-f46e8b66-ad3b-4083-800c-92b6f975d44c req-ee5ccbf5-2406-41dc-bb36-d05543e3ee5b service nova] Creating event network-vif-plugged:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:08:23 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-f46e8b66-ad3b-4083-800c-92b6f975d44c req-ee5ccbf5-2406-41dc-bb36-d05543e3ee5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034762 Apr 14 17:08:23 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 105/310] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:08:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:08:23 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:23 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:23 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:23 user devstack@n-api.service[61933]: DEBUG nova.objects.instance [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'services' on Instance uuid c0488788-7b88-4c48-9fcd-02640c09feb1 {{(pid=61933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:08:23 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-fcb77d92-a3a0-4750-bb50-37aa6b2bfcdb tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1/os-volume_attachments/58c68d43-05ee-458b-b7d0-8bc859d6ebcb" status: 202 len: 0 microversion: 2.1 time: 0.261205 Apr 14 17:08:23 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 104/311] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:08:23 2023] DELETE /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1/os-volume_attachments/58c68d43-05ee-458b-b7d0-8bc859d6ebcb => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:08:23 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-34a80ca5-df69-4ce9-b4d7-e6b7c4d9f532 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:23 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-34a80ca5-df69-4ce9-b4d7-e6b7c4d9f532 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-34a80ca5-df69-4ce9-b4d7-e6b7c4d9f532 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-34a80ca5-df69-4ce9-b4d7-e6b7c4d9f532 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-34a80ca5-df69-4ce9-b4d7-e6b7c4d9f532 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-34a80ca5-df69-4ce9-b4d7-e6b7c4d9f532 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-34a80ca5-df69-4ce9-b4d7-e6b7c4d9f532 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-34a80ca5-df69-4ce9-b4d7-e6b7c4d9f532 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:23 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-34a80ca5-df69-4ce9-b4d7-e6b7c4d9f532 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074041 Apr 14 17:08:23 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 103/312] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:08:23 2023] GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:08:31 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:31 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-684320f9-cd6c-4a43-b526-5bf070c025a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:31 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-684320f9-cd6c-4a43-b526-5bf070c025a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-684320f9-cd6c-4a43-b526-5bf070c025a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-684320f9-cd6c-4a43-b526-5bf070c025a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-684320f9-cd6c-4a43-b526-5bf070c025a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-684320f9-cd6c-4a43-b526-5bf070c025a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-684320f9-cd6c-4a43-b526-5bf070c025a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-684320f9-cd6c-4a43-b526-5bf070c025a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:32 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-684320f9-cd6c-4a43-b526-5bf070c025a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d67df67ba8e4905bf7c6545c5748a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2764eee6c4071b5607f78762ca653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:08:32 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-684320f9-cd6c-4a43-b526-5bf070c025a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd" status: 200 len: 1704 microversion: 2.1 time: 0.622583 Apr 14 17:08:32 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 106/313] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:08:31 2023] GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd => generated 1704 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:08:33 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:33 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b18f71ca-e822-44cc-9bfb-5a66c85f9d9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Action: 'create', calling method: .version_select at 0x7fe19d205b40>, body: {"keypair": {"name": "tempest-keypair-2086238855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJFC8aHWWcd1B2OKM8xgRJWOuubZu8WyhuvxCCUHyDbwuTPBWSPjT8SoG+9FRiu9oyr4dmhioU2TIDdW0FcVGzCucc3oP1Egh2HH6SxTaumSFKNLHUxywdDbLcwsw7FyA=="}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:08:33 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:33 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-b18f71ca-e822-44cc-9bfb-5a66c85f9d9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Getting quotas for project 1ae1b41823a64cd0b1c1a1669ad202ec. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:08:33 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-b18f71ca-e822-44cc-9bfb-5a66c85f9d9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Getting quotas for user 6aa926d6cfc94b08a564404f95da5483 and project 1ae1b41823a64cd0b1c1a1669ad202ec. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:08:33 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-b18f71ca-e822-44cc-9bfb-5a66c85f9d9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.093846 Apr 14 17:08:33 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 105/314] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 17:08:33 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 17:08:35 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-955558461", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f49ab827-654e-4ae2-838a-52bfad1c0937"}], "security_groups": [{"name": "tempest-securitygroup--666501796"}], "key_name": "tempest-keypair-2086238855", "user_data": "}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:08:35 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:35 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:35 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:35 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=12 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:35 user devstack@n-api.service[61934]: DEBUG nova.network.neutron [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] validate_networks() for [('f49ab827-654e-4ae2-838a-52bfad1c0937', None, None, None, None, None)] {{(pid=61934) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:08:36 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:08:36 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:08:36 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:08:36 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:08:36 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:08:36 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:36 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:36 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:36 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:36 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:36 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:36 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Getting quotas for project 1ae1b41823a64cd0b1c1a1669ad202ec. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:08:36 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Getting quotas for user 6aa926d6cfc94b08a564404f95da5483 and project 1ae1b41823a64cd0b1c1a1669ad202ec. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:08:36 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Going to run 1 instances... {{(pid=61934) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:08:36 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:08:36 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-f4742efc-5473-4617-a9f5-ec014eca9936 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 1.132777 Apr 14 17:08:36 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 104/315] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 17:08:35 2023] POST /compute/v2.1/servers => generated 399 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 17:08:36 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-aa499d0a-e907-4a55-b319-86b9334d8558 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:36 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-aa499d0a-e907-4a55-b319-86b9334d8558 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:36 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-aa499d0a-e907-4a55-b319-86b9334d8558 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:08:36 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-aa499d0a-e907-4a55-b319-86b9334d8558 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:08:36 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-aa499d0a-e907-4a55-b319-86b9334d8558 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:08:36 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-aa499d0a-e907-4a55-b319-86b9334d8558 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" status: 200 len: 1275 microversion: 2.20 time: 0.094872 Apr 14 17:08:36 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 107/316] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:08:36 2023] GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c => generated 1275 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:08:39 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-ccdb20e9-177d-4d89-bcee-b0b27e7ee384 req-b5f612b0-0789-4d17-aa08-ed5413d493f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c", "tag": "f606ba05-7c5e-4e88-94ed-a44a82cb8150"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:08:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ccdb20e9-177d-4d89-bcee-b0b27e7ee384 req-b5f612b0-0789-4d17-aa08-ed5413d493f2 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ccdb20e9-177d-4d89-bcee-b0b27e7ee384 req-b5f612b0-0789-4d17-aa08-ed5413d493f2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ccdb20e9-177d-4d89-bcee-b0b27e7ee384 req-b5f612b0-0789-4d17-aa08-ed5413d493f2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-ccdb20e9-177d-4d89-bcee-b0b27e7ee384 req-b5f612b0-0789-4d17-aa08-ed5413d493f2 service nova] Creating event network-changed:f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c on user Apr 14 17:08:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-ccdb20e9-177d-4d89-bcee-b0b27e7ee384 req-b5f612b0-0789-4d17-aa08-ed5413d493f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029853 Apr 14 17:08:39 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 106/317] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:08:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:08:40 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-06f43913-a74c-4e07-8395-4bd74a759fca tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5b8fbf7b-55dd-4428-a02a-33061d64705b"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:08:40 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-06f43913-a74c-4e07-8395-4bd74a759fca tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:40 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-06f43913-a74c-4e07-8395-4bd74a759fca tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:40 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-06f43913-a74c-4e07-8395-4bd74a759fca tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:40 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-06f43913-a74c-4e07-8395-4bd74a759fca tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:40 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-06f43913-a74c-4e07-8395-4bd74a759fca tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:40 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-06f43913-a74c-4e07-8395-4bd74a759fca tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:40 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-06f43913-a74c-4e07-8395-4bd74a759fca tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:40 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-06f43913-a74c-4e07-8395-4bd74a759fca tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] HTTP exception thrown: Volume aa85966a-b8bd-4c95-bd23-e87d10c62df2 could not be found. Apr 14 17:08:40 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-06f43913-a74c-4e07-8395-4bd74a759fca tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] Request method failure captured: Apr 14 17:08:40 user devstack@n-api.service[61934]: request: PUT /compute/v2.1/servers/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/os-volume_attachments/aa85966a-b8bd-4c95-bd23-e87d10c62df2 HTTP/1.1 Apr 14 17:08:40 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:08:40 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:08:40 user devstack@n-api.service[61934]: Connection: close Apr 14 17:08:40 user devstack@n-api.service[61934]: Content-Length: 74 Apr 14 17:08:40 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:08:40 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:08:40 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:08:40 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:08:40 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYdubvCYX2Cmnzxk7hGyuAE02UUuwRlbwTYXr8c_v4kDmEvecz_6uiLOel7WsgwVWKubIpUzyYwFFpVJC8qnxiUgMk92ndqBj5JzHw48-1NHydbCk7q-wICKOvRfVf9zGy63xSctfu6Oy_Xw-b0bll8H4fs4FTUQ5WP2Iv8a4ficOEs Apr 14 17:08:40 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:08:40 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:08:40 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:08:40 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:08:40 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:08:40 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:08:40 user devstack@n-api.service[61934]: X-Project-Id: 08b9e10c360d4d8b99347aa1c1641fc3 Apr 14 17:08:40 user devstack@n-api.service[61934]: X-Project-Name: tempest-VolumesAdminNegativeTest-1384105653 Apr 14 17:08:40 user devstack@n-api.service[61934]: X-Role: admin,reader,member Apr 14 17:08:40 user devstack@n-api.service[61934]: X-Roles: admin,reader,member Apr 14 17:08:40 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/08b9e10c360d4d8b99347aa1c1641fc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/08b9e10c360d4d8b99347aa1c1641fc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/08b9e10c360d4d8b99347aa1c1641fc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:08:40 user devstack@n-api.service[61934]: X-Tenant: tempest-VolumesAdminNegativeTest-1384105653 Apr 14 17:08:40 user devstack@n-api.service[61934]: X-Tenant-Id: 08b9e10c360d4d8b99347aa1c1641fc3 Apr 14 17:08:40 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1384105653 Apr 14 17:08:40 user devstack@n-api.service[61934]: X-User: tempest-VolumesAdminNegativeTest-1384105653-project-admin Apr 14 17:08:40 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:08:40 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:08:40 user devstack@n-api.service[61934]: X-User-Id: cca04a858af34b5a96f3cedbc898e500 Apr 14 17:08:40 user devstack@n-api.service[61934]: X-User-Name: tempest-VolumesAdminNegativeTest-1384105653-project-admin Apr 14 17:08:40 user devstack@n-api.service[61934]: Apr 14 17:08:40 user devstack@n-api.service[61934]: {"volumeAttachment": {"volumeId": "5b8fbf7b-55dd-4428-a02a-33061d64705b"}} Apr 14 17:08:40 user devstack@n-api.service[61934]: method: > Apr 14 17:08:40 user devstack@n-api.service[61934]: exception: Volume aa85966a-b8bd-4c95-bd23-e87d10c62df2 could not be found. Apr 14 17:08:40 user devstack@n-api.service[61934]: action_args: {'server_id': '8c51fc1f-dcf6-4c42-8a4f-4b489c270895', 'id': 'aa85966a-b8bd-4c95-bd23-e87d10c62df2', 'body': {'volumeAttachment': {'volumeId': '5b8fbf7b-55dd-4428-a02a-33061d64705b'}}} Apr 14 17:08:40 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aa85966a-b8bd-4c95-bd23-e87d10c62df2 could not be found. (HTTP 404) (Request-ID: req-0d360d8c-a6fe-445d-b5cc-2e937bac9e54) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aa85966a-b8bd-4c95-bd23-e87d10c62df2 could not be found. Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aa85966a-b8bd-4c95-bd23-e87d10c62df2 could not be found. Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aa85966a-b8bd-4c95-bd23-e87d10c62df2 could not be found. Apr 14 17:08:40 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:08:40 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-06f43913-a74c-4e07-8395-4bd74a759fca tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] Returning 404 to user: Volume aa85966a-b8bd-4c95-bd23-e87d10c62df2 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:08:40 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-06f43913-a74c-4e07-8395-4bd74a759fca tempest-VolumesAdminNegativeTest-1384105653 tempest-VolumesAdminNegativeTest-1384105653-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/os-volume_attachments/aa85966a-b8bd-4c95-bd23-e87d10c62df2" status: 404 len: 109 microversion: 2.1 time: 0.068172 Apr 14 17:08:40 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 105/318] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 17:08:40 2023] PUT /compute/v2.1/servers/8c51fc1f-dcf6-4c42-8a4f-4b489c270895/os-volume_attachments/aa85966a-b8bd-4c95-bd23-e87d10c62df2 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 17:08:40 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-3415c4c2-c3dd-4971-a00f-e8b04365afb8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:40 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-3415c4c2-c3dd-4971-a00f-e8b04365afb8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3415c4c2-c3dd-4971-a00f-e8b04365afb8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3415c4c2-c3dd-4971-a00f-e8b04365afb8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3415c4c2-c3dd-4971-a00f-e8b04365afb8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3415c4c2-c3dd-4971-a00f-e8b04365afb8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3415c4c2-c3dd-4971-a00f-e8b04365afb8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3415c4c2-c3dd-4971-a00f-e8b04365afb8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:40 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-3415c4c2-c3dd-4971-a00f-e8b04365afb8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:08:40 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-3415c4c2-c3dd-4971-a00f-e8b04365afb8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:08:40 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-3415c4c2-c3dd-4971-a00f-e8b04365afb8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:08:40 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-3415c4c2-c3dd-4971-a00f-e8b04365afb8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" status: 200 len: 1690 microversion: 2.87 time: 0.264468 Apr 14 17:08:40 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 108/319] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:08:40 2023] GET /compute/v2.1/servers/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f => generated 1690 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:08:41 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-740b51be-a510-4dbe-a379-70e27c512a72 req-54f95948-1301-4706-8c21-ef184fe10cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c", "name": "network-vif-plugged", "status": "completed", "tag": "f606ba05-7c5e-4e88-94ed-a44a82cb8150"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:08:41 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-740b51be-a510-4dbe-a379-70e27c512a72 req-54f95948-1301-4706-8c21-ef184fe10cc4 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:41 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-740b51be-a510-4dbe-a379-70e27c512a72 req-54f95948-1301-4706-8c21-ef184fe10cc4 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:41 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-740b51be-a510-4dbe-a379-70e27c512a72 req-54f95948-1301-4706-8c21-ef184fe10cc4 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:41 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-740b51be-a510-4dbe-a379-70e27c512a72 req-54f95948-1301-4706-8c21-ef184fe10cc4 service nova] Creating event network-vif-plugged:f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c on user Apr 14 17:08:41 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-740b51be-a510-4dbe-a379-70e27c512a72 req-54f95948-1301-4706-8c21-ef184fe10cc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087849 Apr 14 17:08:41 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 107/320] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:08:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:08:43 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:43 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:43 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:43 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:43 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:43 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:43 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:43 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:43 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Going to try to terminate instance {{(pid=61934) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:08:43 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-6c3c92c2-48bf-42c5-bf40-7699745da73d req-2b9f8e7a-663c-4c7c-8aa1-652cc3e41047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c", "name": "network-vif-plugged", "status": "completed", "tag": "f606ba05-7c5e-4e88-94ed-a44a82cb8150"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:08:43 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-6c3c92c2-48bf-42c5-bf40-7699745da73d req-2b9f8e7a-663c-4c7c-8aa1-652cc3e41047 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:43 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-6c3c92c2-48bf-42c5-bf40-7699745da73d req-2b9f8e7a-663c-4c7c-8aa1-652cc3e41047 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:43 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-6c3c92c2-48bf-42c5-bf40-7699745da73d req-2b9f8e7a-663c-4c7c-8aa1-652cc3e41047 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:43 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-e8d96e54-5bc7-48b1-99f0-29499e0270d7 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8c51fc1f-dcf6-4c42-8a4f-4b489c270895" status: 204 len: 0 microversion: 2.1 time: 0.126499 Apr 14 17:08:43 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 106/321] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:08:43 2023] DELETE /compute/v2.1/servers/8c51fc1f-dcf6-4c42-8a4f-4b489c270895 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 14 17:08:43 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-6c3c92c2-48bf-42c5-bf40-7699745da73d req-2b9f8e7a-663c-4c7c-8aa1-652cc3e41047 service nova] Creating event network-vif-plugged:f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c on user Apr 14 17:08:43 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:43 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-6c3c92c2-48bf-42c5-bf40-7699745da73d req-2b9f8e7a-663c-4c7c-8aa1-652cc3e41047 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038232 Apr 14 17:08:43 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 109/322] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:08:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:08:43 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-271eb7c5-7be6-4799-9734-2fb839588c73 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:43 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-271eb7c5-7be6-4799-9734-2fb839588c73 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-271eb7c5-7be6-4799-9734-2fb839588c73 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-271eb7c5-7be6-4799-9734-2fb839588c73 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-271eb7c5-7be6-4799-9734-2fb839588c73 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-271eb7c5-7be6-4799-9734-2fb839588c73 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-271eb7c5-7be6-4799-9734-2fb839588c73 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-271eb7c5-7be6-4799-9734-2fb839588c73 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:44 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-271eb7c5-7be6-4799-9734-2fb839588c73 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d0e8ec192748edbe2576ef1c1e1cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8f41946e544d0c93cbceb3d03e50a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:08:44 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-271eb7c5-7be6-4799-9734-2fb839588c73 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c51fc1f-dcf6-4c42-8a4f-4b489c270895" status: 200 len: 1501 microversion: 2.1 time: 0.370816 Apr 14 17:08:44 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 108/323] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:08:43 2023] GET /compute/v2.1/servers/8c51fc1f-dcf6-4c42-8a4f-4b489c270895 => generated 1501 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:08:45 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-3b0495ab-80f1-485d-86af-7979af1877db req-5e0a383e-862e-403f-a861-178e02c1ed16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c51fc1f-dcf6-4c42-8a4f-4b489c270895", "name": "network-vif-deleted", "tag": "179579bb-9a96-4128-bdc5-35cbeca29ff5"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:08:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3b0495ab-80f1-485d-86af-7979af1877db req-5e0a383e-862e-403f-a861-178e02c1ed16 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3b0495ab-80f1-485d-86af-7979af1877db req-5e0a383e-862e-403f-a861-178e02c1ed16 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3b0495ab-80f1-485d-86af-7979af1877db req-5e0a383e-862e-403f-a861-178e02c1ed16 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:45 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-3b0495ab-80f1-485d-86af-7979af1877db req-5e0a383e-862e-403f-a861-178e02c1ed16 service nova] Creating event network-vif-deleted:179579bb-9a96-4128-bdc5-35cbeca29ff5 for instance 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 on user Apr 14 17:08:45 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-3b0495ab-80f1-485d-86af-7979af1877db req-5e0a383e-862e-403f-a861-178e02c1ed16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105564 Apr 14 17:08:45 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 107/324] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:08:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:08:45 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c51fc1f-dcf6-4c42-8a4f-4b489c270895", "name": "network-vif-unplugged", "status": "completed", "tag": "179579bb-9a96-4128-bdc5-35cbeca29ff5"}, {"server_uuid": "8c51fc1f-dcf6-4c42-8a4f-4b489c270895", "name": "network-vif-plugged", "status": "completed", "tag": "179579bb-9a96-4128-bdc5-35cbeca29ff5"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:08:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:45 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=19 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:45 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] Creating event network-vif-unplugged:179579bb-9a96-4128-bdc5-35cbeca29ff5 for instance 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 on user Apr 14 17:08:45 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] Creating event network-vif-plugged:179579bb-9a96-4128-bdc5-35cbeca29ff5 for instance 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 on user Apr 14 17:08:45 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-bfe8e8ce-5aae-4c2f-a6a9-f030c63ee0f3 req-41596804-b1c7-43ca-ae00-2c210ff67c56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.035921 Apr 14 17:08:45 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 110/325] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:08:45 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:08:55 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:55 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=10 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:55 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-33fe797e-2048-4dd7-9b32-b36d881fb108 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:55 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-33fe797e-2048-4dd7-9b32-b36d881fb108 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:55 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-33fe797e-2048-4dd7-9b32-b36d881fb108 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:55 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-33fe797e-2048-4dd7-9b32-b36d881fb108 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:55 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-33fe797e-2048-4dd7-9b32-b36d881fb108 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:55 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-33fe797e-2048-4dd7-9b32-b36d881fb108 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:55 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-33fe797e-2048-4dd7-9b32-b36d881fb108 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:55 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-33fe797e-2048-4dd7-9b32-b36d881fb108 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:56 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-33fe797e-2048-4dd7-9b32-b36d881fb108 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.326037 Apr 14 17:08:56 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 109/326] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 17:08:55 2023] GET /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb/os-interface => generated 1828 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:08:56 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:56 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:56 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:56 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:57 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-48e25c27-2dee-4b16-9384-4a0af07f6ec1 req-0b371c8b-e18b-4a93-b64b-3a92ab0d1b4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "tag": "ae212ee6-7785-475c-a4cf-1014775b96a5"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:08:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-48e25c27-2dee-4b16-9384-4a0af07f6ec1 req-0b371c8b-e18b-4a93-b64b-3a92ab0d1b4a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-48e25c27-2dee-4b16-9384-4a0af07f6ec1 req-0b371c8b-e18b-4a93-b64b-3a92ab0d1b4a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-48e25c27-2dee-4b16-9384-4a0af07f6ec1 req-0b371c8b-e18b-4a93-b64b-3a92ab0d1b4a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:57 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-48e25c27-2dee-4b16-9384-4a0af07f6ec1 req-0b371c8b-e18b-4a93-b64b-3a92ab0d1b4a service nova] Creating event network-changed:ae212ee6-7785-475c-a4cf-1014775b96a5 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:08:57 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-48e25c27-2dee-4b16-9384-4a0af07f6ec1 req-0b371c8b-e18b-4a93-b64b-3a92ab0d1b4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087443 Apr 14 17:08:57 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 108/327] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:08:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:08:57 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-3d075d1c-a9d7-440e-8902-a0f939b1ca6a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:57 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-3d075d1c-a9d7-440e-8902-a0f939b1ca6a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:57 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:57 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=15 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:08:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3d075d1c-a9d7-440e-8902-a0f939b1ca6a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3d075d1c-a9d7-440e-8902-a0f939b1ca6a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3d075d1c-a9d7-440e-8902-a0f939b1ca6a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3d075d1c-a9d7-440e-8902-a0f939b1ca6a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3d075d1c-a9d7-440e-8902-a0f939b1ca6a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3d075d1c-a9d7-440e-8902-a0f939b1ca6a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:57 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-3d075d1c-a9d7-440e-8902-a0f939b1ca6a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef6f58f76314333b233365266ef5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447e75d0cc144b9ab741d8591af3959e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:08:57 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-3d075d1c-a9d7-440e-8902-a0f939b1ca6a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eef6f58f76314333b233365266ef5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447e75d0cc144b9ab741d8591af3959e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:08:57 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-3d075d1c-a9d7-440e-8902-a0f939b1ca6a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eef6f58f76314333b233365266ef5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447e75d0cc144b9ab741d8591af3959e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:08:57 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-3d075d1c-a9d7-440e-8902-a0f939b1ca6a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb" status: 200 len: 2827 microversion: 2.42 time: 0.686063 Apr 14 17:08:57 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 111/328] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:08:57 2023] GET /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb => generated 2827 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:08:57 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-f33cebf9-2651-471f-8fee-33bdd2897e7a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:57 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-f33cebf9-2651-471f-8fee-33bdd2897e7a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f33cebf9-2651-471f-8fee-33bdd2897e7a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f33cebf9-2651-471f-8fee-33bdd2897e7a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f33cebf9-2651-471f-8fee-33bdd2897e7a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f33cebf9-2651-471f-8fee-33bdd2897e7a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f33cebf9-2651-471f-8fee-33bdd2897e7a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f33cebf9-2651-471f-8fee-33bdd2897e7a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:57 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-f33cebf9-2651-471f-8fee-33bdd2897e7a tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.125018 Apr 14 17:08:57 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 110/329] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 17:08:57 2023] GET /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb/os-interface => generated 1828 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:08:58 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:58 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:58 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:58 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:58 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:58 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:58 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:58 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:58 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Going to try to terminate instance {{(pid=61934) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:08:58 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-a853abcb-6a39-48ba-ad75-762d11add9aa tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb" status: 204 len: 0 microversion: 2.42 time: 0.123842 Apr 14 17:08:58 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 109/330] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 17:08:58 2023] DELETE /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 17:08:58 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-d898e1fa-2a1e-48e2-97ea-60fa48084408 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:08:58 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-d898e1fa-2a1e-48e2-97ea-60fa48084408 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:08:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d898e1fa-2a1e-48e2-97ea-60fa48084408 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d898e1fa-2a1e-48e2-97ea-60fa48084408 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d898e1fa-2a1e-48e2-97ea-60fa48084408 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d898e1fa-2a1e-48e2-97ea-60fa48084408 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d898e1fa-2a1e-48e2-97ea-60fa48084408 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d898e1fa-2a1e-48e2-97ea-60fa48084408 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:59 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-d898e1fa-2a1e-48e2-97ea-60fa48084408 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef6f58f76314333b233365266ef5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447e75d0cc144b9ab741d8591af3959e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:08:59 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-d898e1fa-2a1e-48e2-97ea-60fa48084408 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eef6f58f76314333b233365266ef5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447e75d0cc144b9ab741d8591af3959e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:08:59 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-d898e1fa-2a1e-48e2-97ea-60fa48084408 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eef6f58f76314333b233365266ef5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447e75d0cc144b9ab741d8591af3959e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:08:59 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-d898e1fa-2a1e-48e2-97ea-60fa48084408 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb" status: 200 len: 2952 microversion: 2.42 time: 0.212885 Apr 14 17:08:59 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 112/331] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:08:58 2023] GET /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb => generated 2952 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:08:59 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-586fb6ed-a391-4575-85c5-5d37485bd9d5 req-1f11b9f2-49ae-4ea2-a9e5-e4c5aa3ce57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-unplugged", "status": "completed", "tag": "ae212ee6-7785-475c-a4cf-1014775b96a5"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:08:59 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-586fb6ed-a391-4575-85c5-5d37485bd9d5 req-1f11b9f2-49ae-4ea2-a9e5-e4c5aa3ce57e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:59 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-586fb6ed-a391-4575-85c5-5d37485bd9d5 req-1f11b9f2-49ae-4ea2-a9e5-e4c5aa3ce57e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:59 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-586fb6ed-a391-4575-85c5-5d37485bd9d5 req-1f11b9f2-49ae-4ea2-a9e5-e4c5aa3ce57e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:59 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-586fb6ed-a391-4575-85c5-5d37485bd9d5 req-1f11b9f2-49ae-4ea2-a9e5-e4c5aa3ce57e service nova] Creating event network-vif-unplugged:ae212ee6-7785-475c-a4cf-1014775b96a5 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:08:59 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-586fb6ed-a391-4575-85c5-5d37485bd9d5 req-1f11b9f2-49ae-4ea2-a9e5-e4c5aa3ce57e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046607 Apr 14 17:08:59 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 111/332] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:08:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:08:59 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-017c246b-8d7b-4fe0-9119-7481f2f40d01 req-5dc22c61-72ae-46b3-8d19-e454a6db3843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-unplugged", "status": "completed", "tag": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:08:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-017c246b-8d7b-4fe0-9119-7481f2f40d01 req-5dc22c61-72ae-46b3-8d19-e454a6db3843 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:08:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-017c246b-8d7b-4fe0-9119-7481f2f40d01 req-5dc22c61-72ae-46b3-8d19-e454a6db3843 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:08:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-017c246b-8d7b-4fe0-9119-7481f2f40d01 req-5dc22c61-72ae-46b3-8d19-e454a6db3843 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:08:59 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-017c246b-8d7b-4fe0-9119-7481f2f40d01 req-5dc22c61-72ae-46b3-8d19-e454a6db3843 service nova] Creating event network-vif-unplugged:ac7ba708-31ec-460a-bcad-14c6b7fb2bea for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:08:59 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-017c246b-8d7b-4fe0-9119-7481f2f40d01 req-5dc22c61-72ae-46b3-8d19-e454a6db3843 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028041 Apr 14 17:08:59 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 110/333] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:08:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:09:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "ae212ee6-7785-475c-a4cf-1014775b96a5"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-unplugged", "status": "completed", "tag": "af8c94dd-8947-4377-b332-64f1da7f7ea6"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "af8c94dd-8947-4377-b332-64f1da7f7ea6"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-unplugged", "status": "completed", "tag": "84d71284-fb7a-4263-8388-5526e6d4e033"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "84d71284-fb7a-4263-8388-5526e6d4e033"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:09:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:01 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Creating event network-vif-plugged:ae212ee6-7785-475c-a4cf-1014775b96a5 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:09:01 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Creating event network-vif-unplugged:af8c94dd-8947-4377-b332-64f1da7f7ea6 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:09:01 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Creating event network-vif-plugged:af8c94dd-8947-4377-b332-64f1da7f7ea6 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:09:01 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Creating event network-vif-unplugged:84d71284-fb7a-4263-8388-5526e6d4e033 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:09:01 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] Creating event network-vif-plugged:84d71284-fb7a-4263-8388-5526e6d4e033 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:09:01 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-34a66ebf-e52c-4a82-80d9-75f8d5c2ed00 req-f647b6b0-1e01-4bce-9232-98b176701c11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.033457 Apr 14 17:09:01 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 113/334] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:09:01 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:09:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "ac7ba708-31ec-460a-bcad-14c6b7fb2bea"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-unplugged", "status": "completed", "tag": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-unplugged", "status": "completed", "tag": "d98ca06a-3268-4d34-9fe9-524860935952"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "d98ca06a-3268-4d34-9fe9-524860935952"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-unplugged", "status": "completed", "tag": "0ecf5b01-5002-45ce-95cb-730296ee6817"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-plugged", "status": "completed", "tag": "0ecf5b01-5002-45ce-95cb-730296ee6817"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:09:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:01 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Creating event network-vif-plugged:ac7ba708-31ec-460a-bcad-14c6b7fb2bea for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:09:01 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Creating event network-vif-unplugged:c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:09:01 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Creating event network-vif-plugged:c88a2f62-0f3f-45e9-8846-d83c3fd2e3d3 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:09:01 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Creating event network-vif-unplugged:d98ca06a-3268-4d34-9fe9-524860935952 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:09:01 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Creating event network-vif-plugged:d98ca06a-3268-4d34-9fe9-524860935952 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:09:01 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Creating event network-vif-unplugged:0ecf5b01-5002-45ce-95cb-730296ee6817 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:09:01 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] Creating event network-vif-plugged:0ecf5b01-5002-45ce-95cb-730296ee6817 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:09:01 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-3dc765ad-e9be-4d12-bdab-21a0c3cabe93 req-adfffc4b-71eb-4feb-a431-83601cb9ff01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.035902 Apr 14 17:09:01 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 112/335] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 17:09:01 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:09:04 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-e699319b-abbe-4a5b-81b1-f60190c495ad req-75f26ddb-9eed-4e32-9b60-425dd635cc23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-deleted", "tag": "ae212ee6-7785-475c-a4cf-1014775b96a5"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:09:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-e699319b-abbe-4a5b-81b1-f60190c495ad req-75f26ddb-9eed-4e32-9b60-425dd635cc23 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-e699319b-abbe-4a5b-81b1-f60190c495ad req-75f26ddb-9eed-4e32-9b60-425dd635cc23 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-e699319b-abbe-4a5b-81b1-f60190c495ad req-75f26ddb-9eed-4e32-9b60-425dd635cc23 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:04 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-e699319b-abbe-4a5b-81b1-f60190c495ad req-75f26ddb-9eed-4e32-9b60-425dd635cc23 service nova] Creating event network-vif-deleted:ae212ee6-7785-475c-a4cf-1014775b96a5 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:09:04 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-e699319b-abbe-4a5b-81b1-f60190c495ad req-75f26ddb-9eed-4e32-9b60-425dd635cc23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030042 Apr 14 17:09:04 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 111/336] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:09:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:09:05 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-9a0038cb-9927-4f2f-92fb-3b0c26480837 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1721862913", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "625db83e-4fcd-4ec5-9fd3-7f1fdd80a121", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "bba4f725-673c-4e1a-a5bb-a435afc40332"}]}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:09:05 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-9a0038cb-9927-4f2f-92fb-3b0c26480837 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] HTTP exception thrown: Block Device 625db83e-4fcd-4ec5-9fd3-7f1fdd80a121 is not bootable. Apr 14 17:09:05 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-9a0038cb-9927-4f2f-92fb-3b0c26480837 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Request method failure captured: Apr 14 17:09:05 user devstack@n-api.service[61935]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 17:09:05 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:09:05 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:09:05 user devstack@n-api.service[61935]: Connection: close Apr 14 17:09:05 user devstack@n-api.service[61935]: Content-Length: 357 Apr 14 17:09:05 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:09:05 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:09:05 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:09:05 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:09:05 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYdeer58jEvUR9ADIlb0N430T-Ds21-KcdHVVoui-D_EAL5w5NtUAiByINleZljOdamOoVfvloz9qBpRKJNkBB-q3J2hMItuCYI1rvO5iZ-gzcRL6EYmrivLdXp9j61AUeL3LT7o_QloEQzxw1RchmjWXo1xX65gA6Tz8oI3QnBXw6g Apr 14 17:09:05 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:09:05 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:09:05 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:09:05 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:09:05 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:09:05 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:09:05 user devstack@n-api.service[61935]: X-Project-Id: 426156fb00db428683851cf731b680d1 Apr 14 17:09:05 user devstack@n-api.service[61935]: X-Project-Name: tempest-ServersNegativeTestJSON-1832599821 Apr 14 17:09:05 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:09:05 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:09:05 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426156fb00db428683851cf731b680d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426156fb00db428683851cf731b680d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/426156fb00db428683851cf731b680d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:09:05 user devstack@n-api.service[61935]: X-Tenant: tempest-ServersNegativeTestJSON-1832599821 Apr 14 17:09:05 user devstack@n-api.service[61935]: X-Tenant-Id: 426156fb00db428683851cf731b680d1 Apr 14 17:09:05 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832599821 Apr 14 17:09:05 user devstack@n-api.service[61935]: X-User: tempest-ServersNegativeTestJSON-1832599821-project-member Apr 14 17:09:05 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:09:05 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:09:05 user devstack@n-api.service[61935]: X-User-Id: 0d1ea0218b044c1e94f61a07c1d14a75 Apr 14 17:09:05 user devstack@n-api.service[61935]: X-User-Name: tempest-ServersNegativeTestJSON-1832599821-project-member Apr 14 17:09:05 user devstack@n-api.service[61935]: Apr 14 17:09:05 user devstack@n-api.service[61935]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1721862913", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "625db83e-4fcd-4ec5-9fd3-7f1fdd80a121", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "bba4f725-673c-4e1a-a5bb-a435afc40332"}]}} Apr 14 17:09:05 user devstack@n-api.service[61935]: method: > Apr 14 17:09:05 user devstack@n-api.service[61935]: exception: Block Device 625db83e-4fcd-4ec5-9fd3-7f1fdd80a121 is not bootable. Apr 14 17:09:05 user devstack@n-api.service[61935]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1721862913', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '625db83e-4fcd-4ec5-9fd3-7f1fdd80a121'}], 'networks': [{'uuid': 'bba4f725-673c-4e1a-a5bb-a435afc40332'}]}}} Apr 14 17:09:05 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 625db83e-4fcd-4ec5-9fd3-7f1fdd80a121 is not bootable. Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 625db83e-4fcd-4ec5-9fd3-7f1fdd80a121 is not bootable. Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 625db83e-4fcd-4ec5-9fd3-7f1fdd80a121 is not bootable. Apr 14 17:09:05 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:09:05 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-9a0038cb-9927-4f2f-92fb-3b0c26480837 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Returning 400 to user: Block Device 625db83e-4fcd-4ec5-9fd3-7f1fdd80a121 is not bootable. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:09:05 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-9a0038cb-9927-4f2f-92fb-3b0c26480837 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.077453 Apr 14 17:09:05 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 114/337] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:09:05 2023] POST /compute/v2.1/servers => generated 110 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:09:05 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-cec89532-0e8e-45c7-9158-af52a916626d tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:09:05 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-cec89532-0e8e-45c7-9158-af52a916626d tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:09:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cec89532-0e8e-45c7-9158-af52a916626d tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cec89532-0e8e-45c7-9158-af52a916626d tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cec89532-0e8e-45c7-9158-af52a916626d tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cec89532-0e8e-45c7-9158-af52a916626d tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cec89532-0e8e-45c7-9158-af52a916626d tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cec89532-0e8e-45c7-9158-af52a916626d tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:05 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a84cb6d8-150b-4069-beb9-0371769c28f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:09:05 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-a84cb6d8-150b-4069-beb9-0371769c28f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:09:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a84cb6d8-150b-4069-beb9-0371769c28f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a84cb6d8-150b-4069-beb9-0371769c28f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a84cb6d8-150b-4069-beb9-0371769c28f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a84cb6d8-150b-4069-beb9-0371769c28f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a84cb6d8-150b-4069-beb9-0371769c28f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a84cb6d8-150b-4069-beb9-0371769c28f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:05 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-a84cb6d8-150b-4069-beb9-0371769c28f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:09:05 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-a84cb6d8-150b-4069-beb9-0371769c28f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1537 microversion: 2.1 time: 0.221506 Apr 14 17:09:05 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 112/338] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:09:05 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1537 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:09:05 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-cec89532-0e8e-45c7-9158-af52a916626d tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1ea0218b044c1e94f61a07c1d14a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426156fb00db428683851cf731b680d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:09:05 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-cec89532-0e8e-45c7-9158-af52a916626d tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d" status: 200 len: 1492 microversion: 2.1 time: 0.368274 Apr 14 17:09:05 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 113/339] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:09:05 2023] GET /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d => generated 1492 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:09:06 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-8bcc2406-827f-4a06-bf30-2063346f5797 req-1b950275-b841-4464-b5e2-000576363f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-deleted", "tag": "af8c94dd-8947-4377-b332-64f1da7f7ea6"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-deleted", "tag": "84d71284-fb7a-4263-8388-5526e6d4e033"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-deleted", "tag": "d98ca06a-3268-4d34-9fe9-524860935952"}, {"server_uuid": "fb079a50-7726-4957-b853-d10c7cba46fb", "name": "network-vif-deleted", "tag": "0ecf5b01-5002-45ce-95cb-730296ee6817"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:09:06 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8bcc2406-827f-4a06-bf30-2063346f5797 req-1b950275-b841-4464-b5e2-000576363f5f service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:06 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8bcc2406-827f-4a06-bf30-2063346f5797 req-1b950275-b841-4464-b5e2-000576363f5f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:06 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8bcc2406-827f-4a06-bf30-2063346f5797 req-1b950275-b841-4464-b5e2-000576363f5f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:06 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-8bcc2406-827f-4a06-bf30-2063346f5797 req-1b950275-b841-4464-b5e2-000576363f5f service nova] Creating event network-vif-deleted:af8c94dd-8947-4377-b332-64f1da7f7ea6 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:09:06 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-8bcc2406-827f-4a06-bf30-2063346f5797 req-1b950275-b841-4464-b5e2-000576363f5f service nova] Creating event network-vif-deleted:84d71284-fb7a-4263-8388-5526e6d4e033 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:09:06 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-8bcc2406-827f-4a06-bf30-2063346f5797 req-1b950275-b841-4464-b5e2-000576363f5f service nova] Creating event network-vif-deleted:d98ca06a-3268-4d34-9fe9-524860935952 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:09:06 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-8bcc2406-827f-4a06-bf30-2063346f5797 req-1b950275-b841-4464-b5e2-000576363f5f service nova] Creating event network-vif-deleted:0ecf5b01-5002-45ce-95cb-730296ee6817 for instance fb079a50-7726-4957-b853-d10c7cba46fb on user Apr 14 17:09:06 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-8bcc2406-827f-4a06-bf30-2063346f5797 req-1b950275-b841-4464-b5e2-000576363f5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.032219 Apr 14 17:09:06 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 115/340] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:09:06 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:09:13 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-b55a78a7-7ad7-46be-9866-3cc8fbb11fed tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:09:13 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-b55a78a7-7ad7-46be-9866-3cc8fbb11fed tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:09:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b55a78a7-7ad7-46be-9866-3cc8fbb11fed tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b55a78a7-7ad7-46be-9866-3cc8fbb11fed tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b55a78a7-7ad7-46be-9866-3cc8fbb11fed tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b55a78a7-7ad7-46be-9866-3cc8fbb11fed tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b55a78a7-7ad7-46be-9866-3cc8fbb11fed tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b55a78a7-7ad7-46be-9866-3cc8fbb11fed tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:13 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-b55a78a7-7ad7-46be-9866-3cc8fbb11fed tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052438 Apr 14 17:09:13 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 113/341] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:09:13 2023] GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:09:14 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:09:14 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:09:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:14 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Going to try to terminate instance {{(pid=61933) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:09:14 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-0f6d37f2-23e1-4aa1-82ab-3445cfcfcd5e tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1" status: 204 len: 0 microversion: 2.1 time: 0.113091 Apr 14 17:09:14 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 114/342] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:09:14 2023] DELETE /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:09:14 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-b2e06b74-f00f-4194-87ac-cd3e67967eb9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:09:14 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-b2e06b74-f00f-4194-87ac-cd3e67967eb9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:09:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b2e06b74-f00f-4194-87ac-cd3e67967eb9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b2e06b74-f00f-4194-87ac-cd3e67967eb9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b2e06b74-f00f-4194-87ac-cd3e67967eb9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b2e06b74-f00f-4194-87ac-cd3e67967eb9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b2e06b74-f00f-4194-87ac-cd3e67967eb9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b2e06b74-f00f-4194-87ac-cd3e67967eb9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:14 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-b2e06b74-f00f-4194-87ac-cd3e67967eb9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c9e0d318eb4ca49d47d620682fb00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f341a2096b9483787b569a59f325556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:09:14 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-b2e06b74-f00f-4194-87ac-cd3e67967eb9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1" status: 200 len: 1668 microversion: 2.1 time: 0.261221 Apr 14 17:09:14 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 116/343] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:09:14 2023] GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1 => generated 1668 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:09:14 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-0b64438a-32e1-4094-b263-855fe5392c56 req-832c5651-ff9a-4b0d-8e80-284f6c43cd92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0488788-7b88-4c48-9fcd-02640c09feb1", "name": "network-vif-unplugged", "status": "completed", "tag": "adb6bafa-17f9-4c4e-af68-632cc59c3a03"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:09:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-0b64438a-32e1-4094-b263-855fe5392c56 req-832c5651-ff9a-4b0d-8e80-284f6c43cd92 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-0b64438a-32e1-4094-b263-855fe5392c56 req-832c5651-ff9a-4b0d-8e80-284f6c43cd92 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-0b64438a-32e1-4094-b263-855fe5392c56 req-832c5651-ff9a-4b0d-8e80-284f6c43cd92 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:14 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-0b64438a-32e1-4094-b263-855fe5392c56 req-832c5651-ff9a-4b0d-8e80-284f6c43cd92 service nova] Creating event network-vif-unplugged:adb6bafa-17f9-4c4e-af68-632cc59c3a03 for instance c0488788-7b88-4c48-9fcd-02640c09feb1 on user Apr 14 17:09:14 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-0b64438a-32e1-4094-b263-855fe5392c56 req-832c5651-ff9a-4b0d-8e80-284f6c43cd92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079194 Apr 14 17:09:14 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 114/344] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:09:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:09:16 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-1a7a45fe-d974-4207-8480-4b1d106e6b1c req-64686a98-8f87-4d7d-b89d-f089633785bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0488788-7b88-4c48-9fcd-02640c09feb1", "name": "network-vif-plugged", "status": "completed", "tag": "adb6bafa-17f9-4c4e-af68-632cc59c3a03"}, {"server_uuid": "c0488788-7b88-4c48-9fcd-02640c09feb1", "name": "network-vif-deleted", "tag": "adb6bafa-17f9-4c4e-af68-632cc59c3a03"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:09:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-1a7a45fe-d974-4207-8480-4b1d106e6b1c req-64686a98-8f87-4d7d-b89d-f089633785bc service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-1a7a45fe-d974-4207-8480-4b1d106e6b1c req-64686a98-8f87-4d7d-b89d-f089633785bc service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-1a7a45fe-d974-4207-8480-4b1d106e6b1c req-64686a98-8f87-4d7d-b89d-f089633785bc service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:16 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-1a7a45fe-d974-4207-8480-4b1d106e6b1c req-64686a98-8f87-4d7d-b89d-f089633785bc service nova] Creating event network-vif-plugged:adb6bafa-17f9-4c4e-af68-632cc59c3a03 for instance c0488788-7b88-4c48-9fcd-02640c09feb1 on user Apr 14 17:09:16 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-1a7a45fe-d974-4207-8480-4b1d106e6b1c req-64686a98-8f87-4d7d-b89d-f089633785bc service nova] Creating event network-vif-deleted:adb6bafa-17f9-4c4e-af68-632cc59c3a03 for instance c0488788-7b88-4c48-9fcd-02640c09feb1 on user Apr 14 17:09:16 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-1a7a45fe-d974-4207-8480-4b1d106e6b1c req-64686a98-8f87-4d7d-b89d-f089633785bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029326 Apr 14 17:09:16 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 115/345] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:09:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:09:18 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:09:18 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:09:18 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:18 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:18 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:18 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:18 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:18 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:18 user devstack@n-api.service[61935]: DEBUG nova.objects.instance [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'services' on Instance uuid d68b702a-a0dc-4030-9893-87b4ef44fb97 {{(pid=61935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:09:18 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-ee5492d1-7d09-4447-91e3-2ea653140e29 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97/os-volume_attachments/7ef40a58-0f55-4cad-9da8-5f08f9070aaf" status: 202 len: 0 microversion: 2.1 time: 0.275903 Apr 14 17:09:18 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 117/346] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:09:18 2023] DELETE /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97/os-volume_attachments/7ef40a58-0f55-4cad-9da8-5f08f9070aaf => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:09:20 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-5019566b-98df-4ab4-9b22-9f37812feaf6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:09:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5019566b-98df-4ab4-9b22-9f37812feaf6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5019566b-98df-4ab4-9b22-9f37812feaf6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5019566b-98df-4ab4-9b22-9f37812feaf6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:20 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-5019566b-98df-4ab4-9b22-9f37812feaf6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Going to try to stop instance {{(pid=61934) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 17:09:20 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-5019566b-98df-4ab4-9b22-9f37812feaf6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97/action" status: 202 len: 0 microversion: 2.1 time: 0.117090 Apr 14 17:09:20 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 115/347] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:09:20 2023] POST /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:09:20 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-da39aedf-3630-4742-afbe-28a0642fc414 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:09:20 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-da39aedf-3630-4742-afbe-28a0642fc414 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:09:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-da39aedf-3630-4742-afbe-28a0642fc414 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-da39aedf-3630-4742-afbe-28a0642fc414 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-da39aedf-3630-4742-afbe-28a0642fc414 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-da39aedf-3630-4742-afbe-28a0642fc414 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-da39aedf-3630-4742-afbe-28a0642fc414 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-da39aedf-3630-4742-afbe-28a0642fc414 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:21 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-da39aedf-3630-4742-afbe-28a0642fc414 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c4734925f645248b0f9060aa78a502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8f6b39515e456c9f5a1affa9f79000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:09:21 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-da39aedf-3630-4742-afbe-28a0642fc414 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97" status: 200 len: 1664 microversion: 2.1 time: 0.330458 Apr 14 17:09:21 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 116/348] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:09:20 2023] GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97 => generated 1664 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:09:21 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-43dd54b5-dc04-4176-b0fb-c781384dcddc req-30ee3a17-bb4a-47a9-92b7-57abdc22dff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "name": "network-vif-unplugged", "status": "completed", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:09:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-43dd54b5-dc04-4176-b0fb-c781384dcddc req-30ee3a17-bb4a-47a9-92b7-57abdc22dff4 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-43dd54b5-dc04-4176-b0fb-c781384dcddc req-30ee3a17-bb4a-47a9-92b7-57abdc22dff4 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-43dd54b5-dc04-4176-b0fb-c781384dcddc req-30ee3a17-bb4a-47a9-92b7-57abdc22dff4 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:21 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-43dd54b5-dc04-4176-b0fb-c781384dcddc req-30ee3a17-bb4a-47a9-92b7-57abdc22dff4 service nova] Creating event network-vif-unplugged:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:09:21 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-43dd54b5-dc04-4176-b0fb-c781384dcddc req-30ee3a17-bb4a-47a9-92b7-57abdc22dff4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030157 Apr 14 17:09:21 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 118/349] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:09:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:09:23 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "name": "network-vif-plugged", "status": "completed", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}, {"server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "name": "network-vif-plugged", "status": "completed", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}, {"server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "name": "network-vif-plugged", "status": "completed", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}, {"server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "name": "network-vif-unplugged", "status": "completed", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}, {"server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "name": "network-vif-plugged", "status": "completed", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:09:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:23 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Creating event network-vif-plugged:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:09:23 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Creating event network-vif-plugged:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:09:23 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Creating event network-vif-plugged:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:09:23 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Creating event network-vif-unplugged:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:09:23 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] Creating event network-vif-plugged:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:09:23 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-d5ec847c-1832-477a-896e-400c182bec56 req-717ae502-f63b-49c4-b74b-db3f7d24e156 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.043050 Apr 14 17:09:23 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 116/350] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:09:23 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:09:26 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-05dd68cd-7899-4a8e-ac2b-6205021988d9 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:09:26 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-05dd68cd-7899-4a8e-ac2b-6205021988d9 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:09:26 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:09:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-05dd68cd-7899-4a8e-ac2b-6205021988d9 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-05dd68cd-7899-4a8e-ac2b-6205021988d9 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-05dd68cd-7899-4a8e-ac2b-6205021988d9 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-05dd68cd-7899-4a8e-ac2b-6205021988d9 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-05dd68cd-7899-4a8e-ac2b-6205021988d9 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-05dd68cd-7899-4a8e-ac2b-6205021988d9 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:26 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:09:26 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-05dd68cd-7899-4a8e-ac2b-6205021988d9 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:09:26 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-05dd68cd-7899-4a8e-ac2b-6205021988d9 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:09:26 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-05dd68cd-7899-4a8e-ac2b-6205021988d9 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:09:26 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-05dd68cd-7899-4a8e-ac2b-6205021988d9 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" status: 200 len: 1586 microversion: 2.20 time: 0.230153 Apr 14 17:09:26 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 117/351] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:09:26 2023] GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c => generated 1586 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:09:32 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=16 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:09:32 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:09:32 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-c85230f7-4009-4fbb-a444-a5add8719417 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:09:32 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-c85230f7-4009-4fbb-a444-a5add8719417 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:09:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c85230f7-4009-4fbb-a444-a5add8719417 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c85230f7-4009-4fbb-a444-a5add8719417 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c85230f7-4009-4fbb-a444-a5add8719417 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c85230f7-4009-4fbb-a444-a5add8719417 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c85230f7-4009-4fbb-a444-a5add8719417 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c85230f7-4009-4fbb-a444-a5add8719417 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:32 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-c85230f7-4009-4fbb-a444-a5add8719417 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd/action" status: 202 len: 0 microversion: 2.1 time: 0.079806 Apr 14 17:09:32 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 119/352] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:09:32 2023] POST /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:09:32 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-42f7d65f-4c98-498b-aad9-1136b271513e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:09:32 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-42f7d65f-4c98-498b-aad9-1136b271513e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:09:32 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:09:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-42f7d65f-4c98-498b-aad9-1136b271513e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-42f7d65f-4c98-498b-aad9-1136b271513e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-42f7d65f-4c98-498b-aad9-1136b271513e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-42f7d65f-4c98-498b-aad9-1136b271513e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-42f7d65f-4c98-498b-aad9-1136b271513e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-42f7d65f-4c98-498b-aad9-1136b271513e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:32 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:09:32 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-42f7d65f-4c98-498b-aad9-1136b271513e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.218112 Apr 14 17:09:32 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 117/353] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 17:09:32 2023] GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd/os-interface => generated 282 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:09:33 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-eedc07f4-948c-4302-9bf6-5134bc260ef8 req-55a9f7d0-4edf-4a63-8b48-67ac670b4e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5920661-9030-4cf7-88a0-1ad789eec1bd", "name": "network-vif-unplugged", "status": "completed", "tag": "526282d7-c5ce-4ae0-9745-4e43477222f0"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:09:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-eedc07f4-948c-4302-9bf6-5134bc260ef8 req-55a9f7d0-4edf-4a63-8b48-67ac670b4e07 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-eedc07f4-948c-4302-9bf6-5134bc260ef8 req-55a9f7d0-4edf-4a63-8b48-67ac670b4e07 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-eedc07f4-948c-4302-9bf6-5134bc260ef8 req-55a9f7d0-4edf-4a63-8b48-67ac670b4e07 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:33 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-eedc07f4-948c-4302-9bf6-5134bc260ef8 req-55a9f7d0-4edf-4a63-8b48-67ac670b4e07 service nova] Creating event network-vif-unplugged:526282d7-c5ce-4ae0-9745-4e43477222f0 for instance d5920661-9030-4cf7-88a0-1ad789eec1bd on user Apr 14 17:09:33 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-eedc07f4-948c-4302-9bf6-5134bc260ef8 req-55a9f7d0-4edf-4a63-8b48-67ac670b4e07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032476 Apr 14 17:09:33 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 118/354] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:09:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:09:34 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-2553bb0b-494e-4c78-9384-90370295c92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:09:34 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-2553bb0b-494e-4c78-9384-90370295c92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: 8c51fc1f-dcf6-4c42-8a4f-4b489c270895] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:09:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2553bb0b-494e-4c78-9384-90370295c92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2553bb0b-494e-4c78-9384-90370295c92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2553bb0b-494e-4c78-9384-90370295c92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2553bb0b-494e-4c78-9384-90370295c92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2553bb0b-494e-4c78-9384-90370295c92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2553bb0b-494e-4c78-9384-90370295c92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:34 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-2553bb0b-494e-4c78-9384-90370295c92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] HTTP exception thrown: Instance 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 could not be found. Apr 14 17:09:34 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-2553bb0b-494e-4c78-9384-90370295c92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Request method failure captured: Apr 14 17:09:34 user devstack@n-api.service[61935]: request: GET /compute/v2.1/servers/8c51fc1f-dcf6-4c42-8a4f-4b489c270895 HTTP/1.1 Apr 14 17:09:34 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:09:34 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:09:34 user devstack@n-api.service[61935]: Connection: close Apr 14 17:09:34 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:09:34 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:09:34 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:09:34 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:09:34 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:09:34 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYdY2Sp66WTlaGOVw8Vn8Nkb8hEG6cyaydqp0Up56uIGnow8tqr59OiZmv-7AHMbimA99ULzdqwbH2flex8W7c66To6tyEtmrHb3C37NPqfqQD3BqYJGWfbqsvgM9PXlirBa360H2vtm4bYU2qN8KpCtH7BKYATiE6g99FZDs68KQhA Apr 14 17:09:34 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:09:34 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:09:34 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:09:34 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:09:34 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:09:34 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:09:34 user devstack@n-api.service[61935]: X-Project-Id: 5c8f41946e544d0c93cbceb3d03e50a5 Apr 14 17:09:34 user devstack@n-api.service[61935]: X-Project-Name: tempest-VolumesAdminNegativeTest-2070911352 Apr 14 17:09:34 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:09:34 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:09:34 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c8f41946e544d0c93cbceb3d03e50a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c8f41946e544d0c93cbceb3d03e50a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5c8f41946e544d0c93cbceb3d03e50a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:09:34 user devstack@n-api.service[61935]: X-Tenant: tempest-VolumesAdminNegativeTest-2070911352 Apr 14 17:09:34 user devstack@n-api.service[61935]: X-Tenant-Id: 5c8f41946e544d0c93cbceb3d03e50a5 Apr 14 17:09:34 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2070911352 Apr 14 17:09:34 user devstack@n-api.service[61935]: X-User: tempest-VolumesAdminNegativeTest-2070911352-project-member Apr 14 17:09:34 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:09:34 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:09:34 user devstack@n-api.service[61935]: X-User-Id: 01d0e8ec192748edbe2576ef1c1e1cb5 Apr 14 17:09:34 user devstack@n-api.service[61935]: X-User-Name: tempest-VolumesAdminNegativeTest-2070911352-project-member Apr 14 17:09:34 user devstack@n-api.service[61935]: method: > Apr 14 17:09:34 user devstack@n-api.service[61935]: exception: Instance 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 could not be found. Apr 14 17:09:34 user devstack@n-api.service[61935]: action_args: {'id': '8c51fc1f-dcf6-4c42-8a4f-4b489c270895'} Apr 14 17:09:34 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 could not be found. Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 could not be found. Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 could not be found. Apr 14 17:09:34 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:09:34 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-2553bb0b-494e-4c78-9384-90370295c92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Returning 404 to user: Instance 8c51fc1f-dcf6-4c42-8a4f-4b489c270895 could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:09:34 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-2553bb0b-494e-4c78-9384-90370295c92f tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c51fc1f-dcf6-4c42-8a4f-4b489c270895" status: 404 len: 111 microversion: 2.1 time: 0.029608 Apr 14 17:09:34 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 120/355] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:09:34 2023] GET /compute/v2.1/servers/8c51fc1f-dcf6-4c42-8a4f-4b489c270895 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:09:35 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5920661-9030-4cf7-88a0-1ad789eec1bd", "name": "network-vif-plugged", "status": "completed", "tag": "526282d7-c5ce-4ae0-9745-4e43477222f0"}, {"name": "network-changed", "server_uuid": "d5920661-9030-4cf7-88a0-1ad789eec1bd", "tag": "526282d7-c5ce-4ae0-9745-4e43477222f0"}, {"name": "network-changed", "server_uuid": "d5920661-9030-4cf7-88a0-1ad789eec1bd", "tag": "526282d7-c5ce-4ae0-9745-4e43477222f0"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:09:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:35 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] Creating event network-vif-plugged:526282d7-c5ce-4ae0-9745-4e43477222f0 for instance d5920661-9030-4cf7-88a0-1ad789eec1bd on user Apr 14 17:09:35 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] Creating event network-changed:526282d7-c5ce-4ae0-9745-4e43477222f0 for instance d5920661-9030-4cf7-88a0-1ad789eec1bd on user Apr 14 17:09:35 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] Creating event network-changed:526282d7-c5ce-4ae0-9745-4e43477222f0 for instance d5920661-9030-4cf7-88a0-1ad789eec1bd on user Apr 14 17:09:35 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-12bf8566-9bdd-4284-a46b-8fa1186fcb47 req-075c6357-0deb-4bcc-9f51-267942ae4c6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.078884 Apr 14 17:09:35 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 118/356] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:09:35 2023] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:09:37 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5920661-9030-4cf7-88a0-1ad789eec1bd", "name": "network-vif-plugged", "status": "completed", "tag": "526282d7-c5ce-4ae0-9745-4e43477222f0"}, {"server_uuid": "d5920661-9030-4cf7-88a0-1ad789eec1bd", "name": "network-vif-plugged", "status": "completed", "tag": "526282d7-c5ce-4ae0-9745-4e43477222f0"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:09:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:37 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] Creating event network-vif-plugged:526282d7-c5ce-4ae0-9745-4e43477222f0 for instance d5920661-9030-4cf7-88a0-1ad789eec1bd on user Apr 14 17:09:37 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] Creating event network-vif-plugged:526282d7-c5ce-4ae0-9745-4e43477222f0 for instance d5920661-9030-4cf7-88a0-1ad789eec1bd on user Apr 14 17:09:37 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-29b974d7-5370-4f7f-b566-a8853aca38f2 req-b0827ea6-c77f-423e-99eb-b6638d4e0a01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041280 Apr 14 17:09:37 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 119/357] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:09:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:09:38 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:09:38 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:09:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:38 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Going to try to terminate instance {{(pid=61935) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:09:38 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-7767c5f4-5d12-489a-9a74-1a32118237b6 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4" status: 204 len: 0 microversion: 2.1 time: 0.137167 Apr 14 17:09:38 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 121/358] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:09:38 2023] DELETE /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:09:38 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a5eb1063-194f-48a7-bfdd-7c0db06483b9 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:09:38 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-a5eb1063-194f-48a7-bfdd-7c0db06483b9 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:09:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a5eb1063-194f-48a7-bfdd-7c0db06483b9 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a5eb1063-194f-48a7-bfdd-7c0db06483b9 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a5eb1063-194f-48a7-bfdd-7c0db06483b9 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a5eb1063-194f-48a7-bfdd-7c0db06483b9 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a5eb1063-194f-48a7-bfdd-7c0db06483b9 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a5eb1063-194f-48a7-bfdd-7c0db06483b9 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:39 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-a5eb1063-194f-48a7-bfdd-7c0db06483b9 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d0e8ec192748edbe2576ef1c1e1cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8f41946e544d0c93cbceb3d03e50a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:09:39 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-a5eb1063-194f-48a7-bfdd-7c0db06483b9 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4" status: 200 len: 1668 microversion: 2.1 time: 0.361230 Apr 14 17:09:39 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 119/359] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:09:38 2023] GET /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4 => generated 1668 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:09:39 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-81e87f73-6196-4e31-a017-764673ecc634 req-5edd337e-7d59-4aac-add2-59c23dd9fb8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add03bde-bc0e-436a-a994-e81c3f75e4c4", "name": "network-vif-unplugged", "status": "completed", "tag": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:09:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-81e87f73-6196-4e31-a017-764673ecc634 req-5edd337e-7d59-4aac-add2-59c23dd9fb8d service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-81e87f73-6196-4e31-a017-764673ecc634 req-5edd337e-7d59-4aac-add2-59c23dd9fb8d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-81e87f73-6196-4e31-a017-764673ecc634 req-5edd337e-7d59-4aac-add2-59c23dd9fb8d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-81e87f73-6196-4e31-a017-764673ecc634 req-5edd337e-7d59-4aac-add2-59c23dd9fb8d service nova] Creating event network-vif-unplugged:0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance add03bde-bc0e-436a-a994-e81c3f75e4c4 on user Apr 14 17:09:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-81e87f73-6196-4e31-a017-764673ecc634 req-5edd337e-7d59-4aac-add2-59c23dd9fb8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040839 Apr 14 17:09:39 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 120/360] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:09:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:09:40 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-858727606"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:09:40 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:09:41 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:41 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:41 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:41 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:41 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:41 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:41 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add03bde-bc0e-436a-a994-e81c3f75e4c4", "name": "network-vif-plugged", "status": "completed", "tag": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488"}, {"server_uuid": "add03bde-bc0e-436a-a994-e81c3f75e4c4", "name": "network-vif-plugged", "status": "completed", "tag": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488"}, {"server_uuid": "add03bde-bc0e-436a-a994-e81c3f75e4c4", "name": "network-vif-plugged", "status": "completed", "tag": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488"}, {"server_uuid": "add03bde-bc0e-436a-a994-e81c3f75e4c4", "name": "network-vif-unplugged", "status": "completed", "tag": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488"}, {"server_uuid": "add03bde-bc0e-436a-a994-e81c3f75e4c4", "name": "network-vif-plugged", "status": "completed", "tag": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488"}, {"server_uuid": "add03bde-bc0e-436a-a994-e81c3f75e4c4", "name": "network-vif-deleted", "tag": "0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:09:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:41 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Creating event network-vif-plugged:0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance add03bde-bc0e-436a-a994-e81c3f75e4c4 on user Apr 14 17:09:41 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Creating event network-vif-plugged:0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance add03bde-bc0e-436a-a994-e81c3f75e4c4 on user Apr 14 17:09:41 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Creating event network-vif-plugged:0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance add03bde-bc0e-436a-a994-e81c3f75e4c4 on user Apr 14 17:09:41 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Creating event network-vif-unplugged:0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance add03bde-bc0e-436a-a994-e81c3f75e4c4 on user Apr 14 17:09:41 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Creating event network-vif-plugged:0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance add03bde-bc0e-436a-a994-e81c3f75e4c4 on user Apr 14 17:09:41 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] Creating event network-vif-deleted:0e8968b4-33b5-4b5e-a6dc-4c25cb3eb488 for instance add03bde-bc0e-436a-a994-e81c3f75e4c4 on user Apr 14 17:09:41 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-eb21d690-9a0d-43de-a8f1-092b30ab119a req-36b7feb4-9f48-4ae2-8b92-b66d44ccd8d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.038121 Apr 14 17:09:41 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 120/361] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:09:41 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:09:41 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-70d088e8-54fe-4169-b4a3-3aa567ceea84 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/action" status: 202 len: 52 microversion: 2.87 time: 1.011801 Apr 14 17:09:41 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 122/362] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 17:09:40 2023] POST /compute/v2.1/servers/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f/action => generated 52 bytes in 1014 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 17:09:47 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-23f9a31d-63a7-49ac-9ef8-cebcba37a772 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:09:47 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-23f9a31d-63a7-49ac-9ef8-cebcba37a772 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:09:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-23f9a31d-63a7-49ac-9ef8-cebcba37a772 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-23f9a31d-63a7-49ac-9ef8-cebcba37a772 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-23f9a31d-63a7-49ac-9ef8-cebcba37a772 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-23f9a31d-63a7-49ac-9ef8-cebcba37a772 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-23f9a31d-63a7-49ac-9ef8-cebcba37a772 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-23f9a31d-63a7-49ac-9ef8-cebcba37a772 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:47 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-23f9a31d-63a7-49ac-9ef8-cebcba37a772 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:09:47 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-23f9a31d-63a7-49ac-9ef8-cebcba37a772 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:09:47 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-23f9a31d-63a7-49ac-9ef8-cebcba37a772 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:09:47 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-23f9a31d-63a7-49ac-9ef8-cebcba37a772 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" status: 200 len: 1690 microversion: 2.87 time: 0.266201 Apr 14 17:09:47 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 121/363] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:09:47 2023] GET /compute/v2.1/servers/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f => generated 1690 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:09:49 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-4bec639e-dc16-46c9-bee1-79cc4e8be7f2 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:09:49 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-4bec639e-dc16-46c9-bee1-79cc4e8be7f2 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:09:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4bec639e-dc16-46c9-bee1-79cc4e8be7f2 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4bec639e-dc16-46c9-bee1-79cc4e8be7f2 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4bec639e-dc16-46c9-bee1-79cc4e8be7f2 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4bec639e-dc16-46c9-bee1-79cc4e8be7f2 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4bec639e-dc16-46c9-bee1-79cc4e8be7f2 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4bec639e-dc16-46c9-bee1-79cc4e8be7f2 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:49 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-4bec639e-dc16-46c9-bee1-79cc4e8be7f2 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] HTTP exception thrown: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. Apr 14 17:09:49 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-4bec639e-dc16-46c9-bee1-79cc4e8be7f2 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Request method failure captured: Apr 14 17:09:49 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb HTTP/1.1 Apr 14 17:09:49 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:09:49 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:09:49 user devstack@n-api.service[61934]: Connection: close Apr 14 17:09:49 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:09:49 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:09:49 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:09:49 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:09:49 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:09:49 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYggRBj-py-Fd9F4Ht80wjiBEqD9pKledzRhswT8eGQSfVPwR4KJabRPJRwATeWXMozYoqcp9Mrq4OJKv0e9mXtC_6ug65V22gVyG7XJ4CH9QfJdAOaRSwvGRTWIfkqFd1Q-NQ6Azi7ZM2pldHlsEKH93NDUblFfJNEW00hL1xkAlRo Apr 14 17:09:49 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:09:49 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:09:49 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:09:49 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:09:49 user devstack@n-api.service[61934]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 17:09:49 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:09:49 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:09:49 user devstack@n-api.service[61934]: X-Project-Id: 447e75d0cc144b9ab741d8591af3959e Apr 14 17:09:49 user devstack@n-api.service[61934]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-195680184 Apr 14 17:09:49 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:09:49 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:09:49 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/447e75d0cc144b9ab741d8591af3959e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/447e75d0cc144b9ab741d8591af3959e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/447e75d0cc144b9ab741d8591af3959e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:09:49 user devstack@n-api.service[61934]: X-Tenant: tempest-TaggedBootDevicesTest_v242-195680184 Apr 14 17:09:49 user devstack@n-api.service[61934]: X-Tenant-Id: 447e75d0cc144b9ab741d8591af3959e Apr 14 17:09:49 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-195680184 Apr 14 17:09:49 user devstack@n-api.service[61934]: X-User: tempest-TaggedBootDevicesTest_v242-195680184-project-member Apr 14 17:09:49 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:09:49 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:09:49 user devstack@n-api.service[61934]: X-User-Id: eef6f58f76314333b233365266ef5c57 Apr 14 17:09:49 user devstack@n-api.service[61934]: X-User-Name: tempest-TaggedBootDevicesTest_v242-195680184-project-member Apr 14 17:09:49 user devstack@n-api.service[61934]: method: > Apr 14 17:09:49 user devstack@n-api.service[61934]: exception: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. Apr 14 17:09:49 user devstack@n-api.service[61934]: action_args: {'id': 'fb079a50-7726-4957-b853-d10c7cba46fb'} Apr 14 17:09:49 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. Apr 14 17:09:49 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:09:49 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-4bec639e-dc16-46c9-bee1-79cc4e8be7f2 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Returning 404 to user: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:09:49 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-4bec639e-dc16-46c9-bee1-79cc4e8be7f2 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb" status: 404 len: 111 microversion: 2.42 time: 0.033749 Apr 14 17:09:49 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 121/364] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:09:49 2023] GET /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:09:49 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-3a7064c9-bf54-42b9-b69a-b7aba194df9e tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Calling method '.version_select at 0x7fe19cfade10>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:09:49 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-3a7064c9-bf54-42b9-b69a-b7aba194df9e tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-635785217" status: 204 len: 0 microversion: 2.42 time: 0.030890 Apr 14 17:09:49 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 123/365] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 17:09:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-635785217 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 17:09:52 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-3da206a8-7600-4d49-8419-42a63ac95f71 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:09:52 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-3da206a8-7600-4d49-8419-42a63ac95f71 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:09:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3da206a8-7600-4d49-8419-42a63ac95f71 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3da206a8-7600-4d49-8419-42a63ac95f71 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3da206a8-7600-4d49-8419-42a63ac95f71 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3da206a8-7600-4d49-8419-42a63ac95f71 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3da206a8-7600-4d49-8419-42a63ac95f71 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3da206a8-7600-4d49-8419-42a63ac95f71 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:52 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-3da206a8-7600-4d49-8419-42a63ac95f71 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] HTTP exception thrown: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. Apr 14 17:09:52 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-3da206a8-7600-4d49-8419-42a63ac95f71 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Request method failure captured: Apr 14 17:09:52 user devstack@n-api.service[61933]: request: DELETE /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb HTTP/1.1 Apr 14 17:09:52 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:09:52 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:09:52 user devstack@n-api.service[61933]: Connection: close Apr 14 17:09:52 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:09:52 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:09:52 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:09:52 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:09:52 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:09:52 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYggRBj-py-Fd9F4Ht80wjiBEqD9pKledzRhswT8eGQSfVPwR4KJabRPJRwATeWXMozYoqcp9Mrq4OJKv0e9mXtC_6ug65V22gVyG7XJ4CH9QfJdAOaRSwvGRTWIfkqFd1Q-NQ6Azi7ZM2pldHlsEKH93NDUblFfJNEW00hL1xkAlRo Apr 14 17:09:52 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:09:52 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:09:52 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:09:52 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:09:52 user devstack@n-api.service[61933]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 17:09:52 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:09:52 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:09:52 user devstack@n-api.service[61933]: X-Project-Id: 447e75d0cc144b9ab741d8591af3959e Apr 14 17:09:52 user devstack@n-api.service[61933]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-195680184 Apr 14 17:09:52 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:09:52 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:09:52 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/447e75d0cc144b9ab741d8591af3959e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/447e75d0cc144b9ab741d8591af3959e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/447e75d0cc144b9ab741d8591af3959e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:09:52 user devstack@n-api.service[61933]: X-Tenant: tempest-TaggedBootDevicesTest_v242-195680184 Apr 14 17:09:52 user devstack@n-api.service[61933]: X-Tenant-Id: 447e75d0cc144b9ab741d8591af3959e Apr 14 17:09:52 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-195680184 Apr 14 17:09:52 user devstack@n-api.service[61933]: X-User: tempest-TaggedBootDevicesTest_v242-195680184-project-member Apr 14 17:09:52 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:09:52 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:09:52 user devstack@n-api.service[61933]: X-User-Id: eef6f58f76314333b233365266ef5c57 Apr 14 17:09:52 user devstack@n-api.service[61933]: X-User-Name: tempest-TaggedBootDevicesTest_v242-195680184-project-member Apr 14 17:09:52 user devstack@n-api.service[61933]: method: > Apr 14 17:09:52 user devstack@n-api.service[61933]: exception: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. Apr 14 17:09:52 user devstack@n-api.service[61933]: action_args: {'id': 'fb079a50-7726-4957-b853-d10c7cba46fb'} Apr 14 17:09:52 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. Apr 14 17:09:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:09:52 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-3da206a8-7600-4d49-8419-42a63ac95f71 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Returning 404 to user: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:09:52 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-3da206a8-7600-4d49-8419-42a63ac95f71 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb" status: 404 len: 111 microversion: 2.42 time: 0.031706 Apr 14 17:09:52 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 122/366] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 17:09:52 2023] DELETE /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:09:52 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-3dd2dd9d-f343-4356-ba9d-ae4f2f474b81 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:09:52 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-3dd2dd9d-f343-4356-ba9d-ae4f2f474b81 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] [instance: fb079a50-7726-4957-b853-d10c7cba46fb] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:09:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3dd2dd9d-f343-4356-ba9d-ae4f2f474b81 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3dd2dd9d-f343-4356-ba9d-ae4f2f474b81 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3dd2dd9d-f343-4356-ba9d-ae4f2f474b81 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3dd2dd9d-f343-4356-ba9d-ae4f2f474b81 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:09:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3dd2dd9d-f343-4356-ba9d-ae4f2f474b81 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:09:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3dd2dd9d-f343-4356-ba9d-ae4f2f474b81 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:09:52 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-3dd2dd9d-f343-4356-ba9d-ae4f2f474b81 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] HTTP exception thrown: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. Apr 14 17:09:52 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-3dd2dd9d-f343-4356-ba9d-ae4f2f474b81 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Request method failure captured: Apr 14 17:09:52 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb HTTP/1.1 Apr 14 17:09:52 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:09:52 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:09:52 user devstack@n-api.service[61934]: Connection: close Apr 14 17:09:52 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:09:52 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:09:52 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:09:52 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:09:52 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:09:52 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYggRBj-py-Fd9F4Ht80wjiBEqD9pKledzRhswT8eGQSfVPwR4KJabRPJRwATeWXMozYoqcp9Mrq4OJKv0e9mXtC_6ug65V22gVyG7XJ4CH9QfJdAOaRSwvGRTWIfkqFd1Q-NQ6Azi7ZM2pldHlsEKH93NDUblFfJNEW00hL1xkAlRo Apr 14 17:09:52 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:09:52 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:09:52 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:09:52 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:09:52 user devstack@n-api.service[61934]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 17:09:52 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:09:52 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:09:52 user devstack@n-api.service[61934]: X-Project-Id: 447e75d0cc144b9ab741d8591af3959e Apr 14 17:09:52 user devstack@n-api.service[61934]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-195680184 Apr 14 17:09:52 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:09:52 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:09:52 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/447e75d0cc144b9ab741d8591af3959e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/447e75d0cc144b9ab741d8591af3959e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/447e75d0cc144b9ab741d8591af3959e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:09:52 user devstack@n-api.service[61934]: X-Tenant: tempest-TaggedBootDevicesTest_v242-195680184 Apr 14 17:09:52 user devstack@n-api.service[61934]: X-Tenant-Id: 447e75d0cc144b9ab741d8591af3959e Apr 14 17:09:52 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-195680184 Apr 14 17:09:52 user devstack@n-api.service[61934]: X-User: tempest-TaggedBootDevicesTest_v242-195680184-project-member Apr 14 17:09:52 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:09:52 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:09:52 user devstack@n-api.service[61934]: X-User-Id: eef6f58f76314333b233365266ef5c57 Apr 14 17:09:52 user devstack@n-api.service[61934]: X-User-Name: tempest-TaggedBootDevicesTest_v242-195680184-project-member Apr 14 17:09:52 user devstack@n-api.service[61934]: method: > Apr 14 17:09:52 user devstack@n-api.service[61934]: exception: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. Apr 14 17:09:52 user devstack@n-api.service[61934]: action_args: {'id': 'fb079a50-7726-4957-b853-d10c7cba46fb'} Apr 14 17:09:52 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. Apr 14 17:09:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:09:52 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-3dd2dd9d-f343-4356-ba9d-ae4f2f474b81 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] Returning 404 to user: Instance fb079a50-7726-4957-b853-d10c7cba46fb could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:09:52 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-3dd2dd9d-f343-4356-ba9d-ae4f2f474b81 tempest-TaggedBootDevicesTest_v242-195680184 tempest-TaggedBootDevicesTest_v242-195680184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb" status: 404 len: 111 microversion: 2.42 time: 0.029794 Apr 14 17:09:52 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 122/367] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:09:52 2023] GET /compute/v2.1/servers/fb079a50-7726-4957-b853-d10c7cba46fb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:10:04 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:04 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:04 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-7ce8bbbb-538c-4c94-b704-16632bf310e5 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:04 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-7ce8bbbb-538c-4c94-b704-16632bf310e5 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7ce8bbbb-538c-4c94-b704-16632bf310e5 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7ce8bbbb-538c-4c94-b704-16632bf310e5 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7ce8bbbb-538c-4c94-b704-16632bf310e5 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7ce8bbbb-538c-4c94-b704-16632bf310e5 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7ce8bbbb-538c-4c94-b704-16632bf310e5 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7ce8bbbb-538c-4c94-b704-16632bf310e5 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:04 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-7ce8bbbb-538c-4c94-b704-16632bf310e5 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] HTTP exception thrown: Instance c0488788-7b88-4c48-9fcd-02640c09feb1 could not be found. Apr 14 17:10:04 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-7ce8bbbb-538c-4c94-b704-16632bf310e5 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Request method failure captured: Apr 14 17:10:04 user devstack@n-api.service[61935]: request: GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1 HTTP/1.1 Apr 14 17:10:04 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:10:04 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:10:04 user devstack@n-api.service[61935]: Connection: close Apr 14 17:10:04 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:10:04 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:10:04 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:10:04 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:10:04 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:10:04 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYdYtBTMjEs6wq_AX7uLwl48FezTrz7FyW6CSVOm9G6i0ttgahwJf1S74Fss_9qd0JO9t5wr7pQDv25cSrw7tI0XNOdCBZPRJQlF-w0w2Xn2ZRZ5EUArK2xGuE0HglaJJpHNyoLBzYQsp9Av8_ba24psGn8qYzpzCLzlLWiMZvDXQQQ Apr 14 17:10:04 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:10:04 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:10:04 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:10:04 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:10:04 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:10:04 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:10:04 user devstack@n-api.service[61935]: X-Project-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:10:04 user devstack@n-api.service[61935]: X-Project-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:10:04 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:10:04 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:10:04 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6f341a2096b9483787b569a59f325556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:10:04 user devstack@n-api.service[61935]: X-Tenant: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:10:04 user devstack@n-api.service[61935]: X-Tenant-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:10:04 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:10:04 user devstack@n-api.service[61935]: X-User: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:10:04 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:10:04 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:10:04 user devstack@n-api.service[61935]: X-User-Id: d9c9e0d318eb4ca49d47d620682fb00a Apr 14 17:10:04 user devstack@n-api.service[61935]: X-User-Name: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:10:04 user devstack@n-api.service[61935]: method: > Apr 14 17:10:04 user devstack@n-api.service[61935]: exception: Instance c0488788-7b88-4c48-9fcd-02640c09feb1 could not be found. Apr 14 17:10:04 user devstack@n-api.service[61935]: action_args: {'id': 'c0488788-7b88-4c48-9fcd-02640c09feb1'} Apr 14 17:10:04 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0488788-7b88-4c48-9fcd-02640c09feb1 could not be found. Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0488788-7b88-4c48-9fcd-02640c09feb1 could not be found. Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0488788-7b88-4c48-9fcd-02640c09feb1 could not be found. Apr 14 17:10:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:10:04 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-7ce8bbbb-538c-4c94-b704-16632bf310e5 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Returning 404 to user: Instance c0488788-7b88-4c48-9fcd-02640c09feb1 could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:10:04 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-7ce8bbbb-538c-4c94-b704-16632bf310e5 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1" status: 404 len: 111 microversion: 2.1 time: 0.038985 Apr 14 17:10:04 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 124/368] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:10:04 2023] GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:10:04 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-29de5916-a86c-4946-b5a2-6aeb42c6a251 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '.version_select at 0x7fe19cf00af0>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:04 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=13 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:04 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=19 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:04 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-29de5916-a86c-4946-b5a2-6aeb42c6a251 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-425177179" status: 202 len: 0 microversion: 2.1 time: 0.029052 Apr 14 17:10:04 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 123/369] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 17:10:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-425177179 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:10:05 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-b5be8286-ebfe-440a-9867-0b938a10d72b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Action: 'create', calling method: .version_select at 0x7fe19d0f84c0>, body: {"keypair": {"name": "tempest-keypair-2060261619", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFTdefih26p4VWLlEtU9B5X8kXev8KrkLhnDrViyCkzWshAjGw+6zUvio9aNibzsCRg3M8zqQXAtV/jSH9vT630W3rFV6Oo2EOMEB51kmqtYD1qr26uKQ8UwWYLpsALnQ=="}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:05 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=11 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:05 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=17 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:05 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-b5be8286-ebfe-440a-9867-0b938a10d72b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting quotas for project 6f341a2096b9483787b569a59f325556. Resources: {'key_pairs'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:10:05 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-b5be8286-ebfe-440a-9867-0b938a10d72b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting quotas for user d9c9e0d318eb4ca49d47d620682fb00a and project 6f341a2096b9483787b569a59f325556. Resources: {'key_pairs'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:10:05 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-b5be8286-ebfe-440a-9867-0b938a10d72b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053156 Apr 14 17:10:05 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 123/370] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 17:10:05 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:10:05 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:05 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:05 user devstack@n-api.service[61935]: DEBUG nova.objects.instance [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lazy-loading 'services' on Instance uuid d5920661-9030-4cf7-88a0-1ad789eec1bd {{(pid=61935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:10:05 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-45e59d12-ac39-426f-b79b-fc1b5dfd0ff8 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd/os-volume_attachments/e5dc56d4-d704-4e10-8ed6-33153ab29a68" status: 202 len: 0 microversion: 2.1 time: 0.181569 Apr 14 17:10:05 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 125/371] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:10:05 2023] DELETE /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd/os-volume_attachments/e5dc56d4-d704-4e10-8ed6-33153ab29a68 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:10:05 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-087c86ca-9fbf-4fc2-8752-bf2b498dd9ea tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:05 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d821aeed-cffa-44be-9942-e2212256e88b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:05 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-d821aeed-cffa-44be-9942-e2212256e88b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:05 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-087c86ca-9fbf-4fc2-8752-bf2b498dd9ea tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-087c86ca-9fbf-4fc2-8752-bf2b498dd9ea tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d821aeed-cffa-44be-9942-e2212256e88b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-087c86ca-9fbf-4fc2-8752-bf2b498dd9ea tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d821aeed-cffa-44be-9942-e2212256e88b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-087c86ca-9fbf-4fc2-8752-bf2b498dd9ea tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d821aeed-cffa-44be-9942-e2212256e88b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-087c86ca-9fbf-4fc2-8752-bf2b498dd9ea tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d821aeed-cffa-44be-9942-e2212256e88b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-087c86ca-9fbf-4fc2-8752-bf2b498dd9ea tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d821aeed-cffa-44be-9942-e2212256e88b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-087c86ca-9fbf-4fc2-8752-bf2b498dd9ea tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d821aeed-cffa-44be-9942-e2212256e88b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:05 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-e55d4b2e-2f6e-4be3-80fd-afd7c28782ff tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:05 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-e55d4b2e-2f6e-4be3-80fd-afd7c28782ff tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:05 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-087c86ca-9fbf-4fc2-8752-bf2b498dd9ea tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055769 Apr 14 17:10:05 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 124/372] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:10:05 2023] GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:10:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e55d4b2e-2f6e-4be3-80fd-afd7c28782ff tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e55d4b2e-2f6e-4be3-80fd-afd7c28782ff tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e55d4b2e-2f6e-4be3-80fd-afd7c28782ff tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e55d4b2e-2f6e-4be3-80fd-afd7c28782ff tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e55d4b2e-2f6e-4be3-80fd-afd7c28782ff tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e55d4b2e-2f6e-4be3-80fd-afd7c28782ff tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:06 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-e55d4b2e-2f6e-4be3-80fd-afd7c28782ff tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1ea0218b044c1e94f61a07c1d14a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426156fb00db428683851cf731b680d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:10:06 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-e55d4b2e-2f6e-4be3-80fd-afd7c28782ff tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d" status: 200 len: 1492 microversion: 2.1 time: 0.260861 Apr 14 17:10:06 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 126/373] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:10:05 2023] GET /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d => generated 1492 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:10:06 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d821aeed-cffa-44be-9942-e2212256e88b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.352435 Apr 14 17:10:06 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 124/374] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 17:10:05 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/os-interface => generated 282 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:10:06 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-128880765", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "06f3eb05-9ead-4131-b955-af3bc09e9758"}], "security_groups": [{"name": "tempest-securitygroup--783953475"}], "key_name": "tempest-keypair-2060261619", "user_data": "}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:06 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-079ddf10-e100-4947-b305-f8d95bcaabf8 req-16221a59-8270-4402-8947-baf8caef6023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "tag": "de268504-352a-4d08-8113-a2098b794478"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:06 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-079ddf10-e100-4947-b305-f8d95bcaabf8 req-16221a59-8270-4402-8947-baf8caef6023 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:06 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-079ddf10-e100-4947-b305-f8d95bcaabf8 req-16221a59-8270-4402-8947-baf8caef6023 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:06 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-079ddf10-e100-4947-b305-f8d95bcaabf8 req-16221a59-8270-4402-8947-baf8caef6023 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:06 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-079ddf10-e100-4947-b305-f8d95bcaabf8 req-16221a59-8270-4402-8947-baf8caef6023 service nova] Creating event network-changed:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:10:06 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-079ddf10-e100-4947-b305-f8d95bcaabf8 req-16221a59-8270-4402-8947-baf8caef6023 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031078 Apr 14 17:10:06 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 127/375] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:10:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:10:07 user devstack@n-api.service[61934]: DEBUG nova.network.neutron [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] validate_networks() for [('06f3eb05-9ead-4131-b955-af3bc09e9758', None, None, None, None, None)] {{(pid=61934) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:10:07 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-c11d8625-d66a-4e8a-a511-fd9ca2209154 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:07 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-c11d8625-d66a-4e8a-a511-fd9ca2209154 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c11d8625-d66a-4e8a-a511-fd9ca2209154 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c11d8625-d66a-4e8a-a511-fd9ca2209154 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c11d8625-d66a-4e8a-a511-fd9ca2209154 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c11d8625-d66a-4e8a-a511-fd9ca2209154 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c11d8625-d66a-4e8a-a511-fd9ca2209154 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c11d8625-d66a-4e8a-a511-fd9ca2209154 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:07 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-c11d8625-d66a-4e8a-a511-fd9ca2209154 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:10:07 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-c11d8625-d66a-4e8a-a511-fd9ca2209154 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1537 microversion: 2.1 time: 0.274355 Apr 14 17:10:07 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 125/376] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:10:07 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1537 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:10:07 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-66c46eb4-cc74-4802-ae16-a7b8c6e5b012 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:07 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-66c46eb4-cc74-4802-ae16-a7b8c6e5b012 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-66c46eb4-cc74-4802-ae16-a7b8c6e5b012 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-66c46eb4-cc74-4802-ae16-a7b8c6e5b012 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-66c46eb4-cc74-4802-ae16-a7b8c6e5b012 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-66c46eb4-cc74-4802-ae16-a7b8c6e5b012 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-66c46eb4-cc74-4802-ae16-a7b8c6e5b012 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-66c46eb4-cc74-4802-ae16-a7b8c6e5b012 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:07 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:10:07 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:10:07 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:10:07 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:10:07 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:10:07 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:07 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:07 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:07 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:07 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:07 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:07 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-66c46eb4-cc74-4802-ae16-a7b8c6e5b012 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:10:07 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting quotas for project 6f341a2096b9483787b569a59f325556. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:10:07 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting quotas for user d9c9e0d318eb4ca49d47d620682fb00a and project 6f341a2096b9483787b569a59f325556. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:10:07 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-66c46eb4-cc74-4802-ae16-a7b8c6e5b012 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1537 microversion: 2.1 time: 0.327960 Apr 14 17:10:07 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 128/377] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:10:07 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1537 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:10:07 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Going to run 1 instances... {{(pid=61934) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:10:07 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:10:07 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-0846f0db-8c46-4359-861b-d3147067d365 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.834472 Apr 14 17:10:07 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 125/378] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:10:06 2023] POST /compute/v2.1/servers => generated 399 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:10:07 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-e0209869-e0a0-4e5f-a7c7-ace3c909364f tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:07 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-e0209869-e0a0-4e5f-a7c7-ace3c909364f tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:07 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-e0209869-e0a0-4e5f-a7c7-ace3c909364f tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c9e0d318eb4ca49d47d620682fb00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f341a2096b9483787b569a59f325556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:10:07 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-e0209869-e0a0-4e5f-a7c7-ace3c909364f tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac" status: 200 len: 1235 microversion: 2.1 time: 0.087074 Apr 14 17:10:07 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 126/379] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:10:07 2023] GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac => generated 1235 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:10:10 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-736027c1-3023-4029-a80e-94a6912472a3 req-bf5dc96e-954d-4935-aabf-56eda59e9b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7213d0b2-6eac-449b-aa4b-44088686abac", "tag": "84d1f2c3-e095-4535-92c3-9ff189992179"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-736027c1-3023-4029-a80e-94a6912472a3 req-bf5dc96e-954d-4935-aabf-56eda59e9b31 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-736027c1-3023-4029-a80e-94a6912472a3 req-bf5dc96e-954d-4935-aabf-56eda59e9b31 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-736027c1-3023-4029-a80e-94a6912472a3 req-bf5dc96e-954d-4935-aabf-56eda59e9b31 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:10 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-736027c1-3023-4029-a80e-94a6912472a3 req-bf5dc96e-954d-4935-aabf-56eda59e9b31 service nova] Creating event network-changed:84d1f2c3-e095-4535-92c3-9ff189992179 for instance 7213d0b2-6eac-449b-aa4b-44088686abac on user Apr 14 17:10:10 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-736027c1-3023-4029-a80e-94a6912472a3 req-bf5dc96e-954d-4935-aabf-56eda59e9b31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030018 Apr 14 17:10:10 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 129/380] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:10:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:10:11 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-137d7354-706a-4d95-8199-03f865db3b45 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:11 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-137d7354-706a-4d95-8199-03f865db3b45 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-137d7354-706a-4d95-8199-03f865db3b45 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-137d7354-706a-4d95-8199-03f865db3b45 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-137d7354-706a-4d95-8199-03f865db3b45 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-137d7354-706a-4d95-8199-03f865db3b45 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-137d7354-706a-4d95-8199-03f865db3b45 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-137d7354-706a-4d95-8199-03f865db3b45 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:11 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-137d7354-706a-4d95-8199-03f865db3b45 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c4734925f645248b0f9060aa78a502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8f6b39515e456c9f5a1affa9f79000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:10:11 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-137d7354-706a-4d95-8199-03f865db3b45 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97" status: 200 len: 1641 microversion: 2.1 time: 0.246576 Apr 14 17:10:11 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 126/381] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:10:11 2023] GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97 => generated 1641 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:10:12 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-c794b2ee-948a-418a-b14e-5703e5c61e06 req-e5e78c60-400b-44d5-adb1-baad084997f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7213d0b2-6eac-449b-aa4b-44088686abac", "name": "network-vif-plugged", "status": "completed", "tag": "84d1f2c3-e095-4535-92c3-9ff189992179"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c794b2ee-948a-418a-b14e-5703e5c61e06 req-e5e78c60-400b-44d5-adb1-baad084997f9 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c794b2ee-948a-418a-b14e-5703e5c61e06 req-e5e78c60-400b-44d5-adb1-baad084997f9 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c794b2ee-948a-418a-b14e-5703e5c61e06 req-e5e78c60-400b-44d5-adb1-baad084997f9 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:12 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-c794b2ee-948a-418a-b14e-5703e5c61e06 req-e5e78c60-400b-44d5-adb1-baad084997f9 service nova] Creating event network-vif-plugged:84d1f2c3-e095-4535-92c3-9ff189992179 for instance 7213d0b2-6eac-449b-aa4b-44088686abac on user Apr 14 17:10:12 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-c794b2ee-948a-418a-b14e-5703e5c61e06 req-e5e78c60-400b-44d5-adb1-baad084997f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030098 Apr 14 17:10:12 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 127/382] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:10:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:10:14 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-c9abf93b-48f7-4783-ab71-66aa214e4b4d req-4496261a-515e-4d4c-8b0c-c5538695be4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7213d0b2-6eac-449b-aa4b-44088686abac", "name": "network-vif-plugged", "status": "completed", "tag": "84d1f2c3-e095-4535-92c3-9ff189992179"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c9abf93b-48f7-4783-ab71-66aa214e4b4d req-4496261a-515e-4d4c-8b0c-c5538695be4d service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c9abf93b-48f7-4783-ab71-66aa214e4b4d req-4496261a-515e-4d4c-8b0c-c5538695be4d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c9abf93b-48f7-4783-ab71-66aa214e4b4d req-4496261a-515e-4d4c-8b0c-c5538695be4d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:14 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c9abf93b-48f7-4783-ab71-66aa214e4b4d req-4496261a-515e-4d4c-8b0c-c5538695be4d service nova] Creating event network-vif-plugged:84d1f2c3-e095-4535-92c3-9ff189992179 for instance 7213d0b2-6eac-449b-aa4b-44088686abac on user Apr 14 17:10:14 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-c9abf93b-48f7-4783-ab71-66aa214e4b4d req-4496261a-515e-4d4c-8b0c-c5538695be4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033198 Apr 14 17:10:14 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 130/383] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:10:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 17:10:26 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-c46dea03-2c10-4dc1-8cf5-b8afea443a1c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:26 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-c46dea03-2c10-4dc1-8cf5-b8afea443a1c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:26 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:26 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=10 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:26 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:26 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=14 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:26 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c46dea03-2c10-4dc1-8cf5-b8afea443a1c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:26 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c46dea03-2c10-4dc1-8cf5-b8afea443a1c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:26 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c46dea03-2c10-4dc1-8cf5-b8afea443a1c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:26 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c46dea03-2c10-4dc1-8cf5-b8afea443a1c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:26 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c46dea03-2c10-4dc1-8cf5-b8afea443a1c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:26 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c46dea03-2c10-4dc1-8cf5-b8afea443a1c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:27 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-c46dea03-2c10-4dc1-8cf5-b8afea443a1c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.200355 Apr 14 17:10:27 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 127/384] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 17:10:26 2023] GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/os-interface => generated 282 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 17:10:28 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:28 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:28 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=12 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:28 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-518048b2-249d-41c4-a6e5-a435dee5c7cf req-96e936df-96e8-4d64-bd4f-00f8b95eb903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c", "tag": "f606ba05-7c5e-4e88-94ed-a44a82cb8150"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-518048b2-249d-41c4-a6e5-a435dee5c7cf req-96e936df-96e8-4d64-bd4f-00f8b95eb903 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-518048b2-249d-41c4-a6e5-a435dee5c7cf req-96e936df-96e8-4d64-bd4f-00f8b95eb903 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-518048b2-249d-41c4-a6e5-a435dee5c7cf req-96e936df-96e8-4d64-bd4f-00f8b95eb903 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:28 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-518048b2-249d-41c4-a6e5-a435dee5c7cf req-96e936df-96e8-4d64-bd4f-00f8b95eb903 service nova] Creating event network-changed:f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c on user Apr 14 17:10:28 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-518048b2-249d-41c4-a6e5-a435dee5c7cf req-96e936df-96e8-4d64-bd4f-00f8b95eb903 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048596 Apr 14 17:10:28 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 128/385] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:10:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:10:28 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=14 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:28 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:28 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a16986e5-1597-4696-a7d6-ab08a604f83e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:28 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-a16986e5-1597-4696-a7d6-ab08a604f83e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:28 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a16986e5-1597-4696-a7d6-ab08a604f83e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:28 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a16986e5-1597-4696-a7d6-ab08a604f83e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:28 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a16986e5-1597-4696-a7d6-ab08a604f83e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:28 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a16986e5-1597-4696-a7d6-ab08a604f83e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:28 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a16986e5-1597-4696-a7d6-ab08a604f83e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:28 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a16986e5-1597-4696-a7d6-ab08a604f83e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:28 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-a16986e5-1597-4696-a7d6-ab08a604f83e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/ips" status: 200 len: 110 microversion: 2.20 time: 0.045161 Apr 14 17:10:28 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 131/386] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 17:10:28 2023] GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/ips => generated 110 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 17:10:29 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a007e499-857e-48db-9f0e-8f1553b867db tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:29 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-a007e499-857e-48db-9f0e-8f1553b867db tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] [instance: add03bde-bc0e-436a-a994-e81c3f75e4c4] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a007e499-857e-48db-9f0e-8f1553b867db tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a007e499-857e-48db-9f0e-8f1553b867db tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a007e499-857e-48db-9f0e-8f1553b867db tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a007e499-857e-48db-9f0e-8f1553b867db tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a007e499-857e-48db-9f0e-8f1553b867db tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a007e499-857e-48db-9f0e-8f1553b867db tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:29 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-a007e499-857e-48db-9f0e-8f1553b867db tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] HTTP exception thrown: Instance add03bde-bc0e-436a-a994-e81c3f75e4c4 could not be found. Apr 14 17:10:29 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a007e499-857e-48db-9f0e-8f1553b867db tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Request method failure captured: Apr 14 17:10:29 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4 HTTP/1.1 Apr 14 17:10:29 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:10:29 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:10:29 user devstack@n-api.service[61934]: Connection: close Apr 14 17:10:29 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:10:29 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:10:29 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:10:29 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:10:29 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:10:29 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYdY2Sp66WTlaGOVw8Vn8Nkb8hEG6cyaydqp0Up56uIGnow8tqr59OiZmv-7AHMbimA99ULzdqwbH2flex8W7c66To6tyEtmrHb3C37NPqfqQD3BqYJGWfbqsvgM9PXlirBa360H2vtm4bYU2qN8KpCtH7BKYATiE6g99FZDs68KQhA Apr 14 17:10:29 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:10:29 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:10:29 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:10:29 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:10:29 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:10:29 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:10:29 user devstack@n-api.service[61934]: X-Project-Id: 5c8f41946e544d0c93cbceb3d03e50a5 Apr 14 17:10:29 user devstack@n-api.service[61934]: X-Project-Name: tempest-VolumesAdminNegativeTest-2070911352 Apr 14 17:10:29 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:10:29 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:10:29 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c8f41946e544d0c93cbceb3d03e50a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c8f41946e544d0c93cbceb3d03e50a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5c8f41946e544d0c93cbceb3d03e50a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:10:29 user devstack@n-api.service[61934]: X-Tenant: tempest-VolumesAdminNegativeTest-2070911352 Apr 14 17:10:29 user devstack@n-api.service[61934]: X-Tenant-Id: 5c8f41946e544d0c93cbceb3d03e50a5 Apr 14 17:10:29 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2070911352 Apr 14 17:10:29 user devstack@n-api.service[61934]: X-User: tempest-VolumesAdminNegativeTest-2070911352-project-member Apr 14 17:10:29 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:10:29 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:10:29 user devstack@n-api.service[61934]: X-User-Id: 01d0e8ec192748edbe2576ef1c1e1cb5 Apr 14 17:10:29 user devstack@n-api.service[61934]: X-User-Name: tempest-VolumesAdminNegativeTest-2070911352-project-member Apr 14 17:10:29 user devstack@n-api.service[61934]: method: > Apr 14 17:10:29 user devstack@n-api.service[61934]: exception: Instance add03bde-bc0e-436a-a994-e81c3f75e4c4 could not be found. Apr 14 17:10:29 user devstack@n-api.service[61934]: action_args: {'id': 'add03bde-bc0e-436a-a994-e81c3f75e4c4'} Apr 14 17:10:29 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add03bde-bc0e-436a-a994-e81c3f75e4c4 could not be found. Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add03bde-bc0e-436a-a994-e81c3f75e4c4 could not be found. Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add03bde-bc0e-436a-a994-e81c3f75e4c4 could not be found. Apr 14 17:10:29 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:10:29 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a007e499-857e-48db-9f0e-8f1553b867db tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Returning 404 to user: Instance add03bde-bc0e-436a-a994-e81c3f75e4c4 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:10:29 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-a007e499-857e-48db-9f0e-8f1553b867db tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4" status: 404 len: 111 microversion: 2.1 time: 0.026560 Apr 14 17:10:29 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 128/387] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:10:29 2023] GET /compute/v2.1/servers/add03bde-bc0e-436a-a994-e81c3f75e4c4 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:10:29 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-7b263168-f95c-4f1f-afe6-88e80458b1d8 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] Calling method '.version_select at 0x7fe19d133130>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:29 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-7b263168-f95c-4f1f-afe6-88e80458b1d8 tempest-VolumesAdminNegativeTest-2070911352 tempest-VolumesAdminNegativeTest-2070911352-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1620409315" status: 202 len: 0 microversion: 2.1 time: 0.039798 Apr 14 17:10:29 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 129/388] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 17:10:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1620409315 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:10:30 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:30 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:30 user devstack@n-api.service[61935]: DEBUG nova.objects.instance [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'flavor' on Instance uuid a0fe02ed-b8cd-43ac-9210-d36e8c90de5c {{(pid=61935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:10:31 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-b64f7102-3944-444c-990f-8dea3f2116f8 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/action" status: 202 len: 0 microversion: 2.20 time: 0.908581 Apr 14 17:10:31 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 132/389] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 17:10:30 2023] POST /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/action => generated 0 bytes in 911 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:10:31 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-45b2e592-66ad-45fe-a057-2a0a8a9b983d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:31 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-45b2e592-66ad-45fe-a057-2a0a8a9b983d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-45b2e592-66ad-45fe-a057-2a0a8a9b983d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-45b2e592-66ad-45fe-a057-2a0a8a9b983d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-45b2e592-66ad-45fe-a057-2a0a8a9b983d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-45b2e592-66ad-45fe-a057-2a0a8a9b983d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-45b2e592-66ad-45fe-a057-2a0a8a9b983d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-45b2e592-66ad-45fe-a057-2a0a8a9b983d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:31 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-45b2e592-66ad-45fe-a057-2a0a8a9b983d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:10:31 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-45b2e592-66ad-45fe-a057-2a0a8a9b983d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:10:31 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-45b2e592-66ad-45fe-a057-2a0a8a9b983d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:10:31 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-45b2e592-66ad-45fe-a057-2a0a8a9b983d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" status: 200 len: 1711 microversion: 2.20 time: 0.163250 Apr 14 17:10:31 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 129/390] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:10:31 2023] GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c => generated 1711 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:10:32 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-f5a12904-31e7-49fe-bb2a-db3704a8f50e req-747888f5-7545-4cdb-a0f9-499eebbc11c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c", "name": "network-vif-unplugged", "status": "completed", "tag": "f606ba05-7c5e-4e88-94ed-a44a82cb8150"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:32 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-f5a12904-31e7-49fe-bb2a-db3704a8f50e req-747888f5-7545-4cdb-a0f9-499eebbc11c8 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:32 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-f5a12904-31e7-49fe-bb2a-db3704a8f50e req-747888f5-7545-4cdb-a0f9-499eebbc11c8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:32 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-f5a12904-31e7-49fe-bb2a-db3704a8f50e req-747888f5-7545-4cdb-a0f9-499eebbc11c8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:32 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-f5a12904-31e7-49fe-bb2a-db3704a8f50e req-747888f5-7545-4cdb-a0f9-499eebbc11c8 service nova] Creating event network-vif-unplugged:f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c on user Apr 14 17:10:32 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-f5a12904-31e7-49fe-bb2a-db3704a8f50e req-747888f5-7545-4cdb-a0f9-499eebbc11c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041966 Apr 14 17:10:32 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 130/391] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:10:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:10:34 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-647b8392-46ed-4a02-a1d7-9000bb67e5f8 req-fe363bf3-472e-491b-8c15-f74bbd0c114d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c", "name": "network-vif-plugged", "status": "completed", "tag": "f606ba05-7c5e-4e88-94ed-a44a82cb8150"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-647b8392-46ed-4a02-a1d7-9000bb67e5f8 req-fe363bf3-472e-491b-8c15-f74bbd0c114d service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-647b8392-46ed-4a02-a1d7-9000bb67e5f8 req-fe363bf3-472e-491b-8c15-f74bbd0c114d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-647b8392-46ed-4a02-a1d7-9000bb67e5f8 req-fe363bf3-472e-491b-8c15-f74bbd0c114d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:34 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-647b8392-46ed-4a02-a1d7-9000bb67e5f8 req-fe363bf3-472e-491b-8c15-f74bbd0c114d service nova] Creating event network-vif-plugged:f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c on user Apr 14 17:10:34 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-647b8392-46ed-4a02-a1d7-9000bb67e5f8 req-fe363bf3-472e-491b-8c15-f74bbd0c114d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031974 Apr 14 17:10:34 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 133/392] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:10:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:10:37 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-b87cf321-cbd5-458d-ad4a-3d9e3a020ff2 req-21120a1e-4893-47b1-a873-df1b68b39d51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c", "tag": "f606ba05-7c5e-4e88-94ed-a44a82cb8150"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:37 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b87cf321-cbd5-458d-ad4a-3d9e3a020ff2 req-21120a1e-4893-47b1-a873-df1b68b39d51 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:37 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b87cf321-cbd5-458d-ad4a-3d9e3a020ff2 req-21120a1e-4893-47b1-a873-df1b68b39d51 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:37 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b87cf321-cbd5-458d-ad4a-3d9e3a020ff2 req-21120a1e-4893-47b1-a873-df1b68b39d51 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:37 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-b87cf321-cbd5-458d-ad4a-3d9e3a020ff2 req-21120a1e-4893-47b1-a873-df1b68b39d51 service nova] Creating event network-changed:f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c on user Apr 14 17:10:37 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-b87cf321-cbd5-458d-ad4a-3d9e3a020ff2 req-21120a1e-4893-47b1-a873-df1b68b39d51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045483 Apr 14 17:10:37 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 130/393] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:10:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:10:45 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:45 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:46 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1263709076", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:46 user devstack@n-api.service[61933]: DEBUG nova.network.neutron [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] validate_networks() for [('c5b14da6-ae55-4be0-bbe8-7e1259cadfc3', None, None, None, None, None)] {{(pid=61933) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:10:46 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flavor limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:10:46 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Image limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:10:46 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flavor pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:10:46 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Image pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:10:46 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:10:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:46 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Getting quotas for project 070c6b9f620548b183904d1971f35752. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:10:46 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Getting quotas for user 2434278fe61447fab1f5a930aa16a1de and project 070c6b9f620548b183904d1971f35752. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:10:46 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Going to run 1 instances... {{(pid=61933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:10:46 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:10:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-53eaf4a8-ab6f-4162-a63e-1e1cdebea4e0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.792437 Apr 14 17:10:46 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 131/394] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:10:45 2023] POST /compute/v2.1/servers => generated 381 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:10:46 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:46 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:46 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-bedc29a6-412a-4280-a8a2-731ea386f95d tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:46 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-bedc29a6-412a-4280-a8a2-731ea386f95d tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:46 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-bedc29a6-412a-4280-a8a2-731ea386f95d tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:10:46 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-bedc29a6-412a-4280-a8a2-731ea386f95d tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93" status: 200 len: 1216 microversion: 2.1 time: 0.077952 Apr 14 17:10:46 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 134/395] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:10:46 2023] GET /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93 => generated 1216 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:10:46 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1925938594", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:46 user devstack@n-api.service[61934]: DEBUG nova.network.neutron [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] validate_networks() for [('c5b14da6-ae55-4be0-bbe8-7e1259cadfc3', None, None, None, None, None)] {{(pid=61934) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:10:47 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=14 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:47 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:10:47 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:10:47 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:10:47 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:10:47 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:10:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:47 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Getting quotas for project 070c6b9f620548b183904d1971f35752. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:10:47 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Getting quotas for user 2434278fe61447fab1f5a930aa16a1de and project 070c6b9f620548b183904d1971f35752. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:10:47 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Going to run 1 instances... {{(pid=61934) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:10:47 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:10:47 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-d8cc046b-2d51-491c-829d-11d8dcfc5a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.699522 Apr 14 17:10:47 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 131/396] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:10:46 2023] POST /compute/v2.1/servers => generated 381 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:10:47 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-ac5b9487-0c0e-4c22-a9cd-c0128dcd098b tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:47 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-ac5b9487-0c0e-4c22-a9cd-c0128dcd098b tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:47 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-ac5b9487-0c0e-4c22-a9cd-c0128dcd098b tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:10:47 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-ac5b9487-0c0e-4c22-a9cd-c0128dcd098b tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c01d750-5923-4b61-9f3a-17cf1142f0a5" status: 200 len: 1216 microversion: 2.1 time: 0.067315 Apr 14 17:10:47 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 132/397] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:10:47 2023] GET /compute/v2.1/servers/5c01d750-5923-4b61-9f3a-17cf1142f0a5 => generated 1216 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:10:47 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1024645093", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "d6985162-5d80-43b0-a99f-e724ada7fdf4"}]}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:47 user devstack@n-api.service[61935]: DEBUG nova.network.neutron [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] validate_networks() for [('d6985162-5d80-43b0-a99f-e724ada7fdf4', None, None, None, None, None)] {{(pid=61935) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:10:48 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:10:48 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:10:48 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:10:48 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:10:48 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:10:48 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:48 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:48 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:48 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:48 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:48 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:48 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Getting quotas for project 965bd22f61df40bd89e8ef35fb12bcd3. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:10:48 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Getting quotas for user b5c86125160643958349100fb3a7855b and project 965bd22f61df40bd89e8ef35fb12bcd3. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:10:48 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Going to run 1 instances... {{(pid=61935) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:10:48 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:10:48 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-323f7b4f-1d3d-4726-82e2-4aecd1e94643 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.714316 Apr 14 17:10:48 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 135/398] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 17:10:47 2023] POST /compute/v2.1/servers => generated 378 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 17:10:48 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-017c8df3-e84f-403c-84aa-7f7717eeea63 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:48 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-017c8df3-e84f-403c-84aa-7f7717eeea63 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:48 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-017c8df3-e84f-403c-84aa-7f7717eeea63 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:10:48 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-017c8df3-e84f-403c-84aa-7f7717eeea63 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:10:48 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-017c8df3-e84f-403c-84aa-7f7717eeea63 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:10:48 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-017c8df3-e84f-403c-84aa-7f7717eeea63 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b" status: 200 len: 1395 microversion: 2.87 time: 0.101303 Apr 14 17:10:48 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 132/399] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:10:48 2023] GET /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b => generated 1395 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 17:10:50 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-defe8b50-a609-46c7-a3a0-cd0ea29aa2a8 req-a5d71240-86f4-4fa5-9195-50865b8a8a56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a075e35f-c43c-4e3a-adb2-2e1629079d93", "tag": "1477a3d2-85fc-4f05-83a0-156f88fc4939"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-defe8b50-a609-46c7-a3a0-cd0ea29aa2a8 req-a5d71240-86f4-4fa5-9195-50865b8a8a56 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-defe8b50-a609-46c7-a3a0-cd0ea29aa2a8 req-a5d71240-86f4-4fa5-9195-50865b8a8a56 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-defe8b50-a609-46c7-a3a0-cd0ea29aa2a8 req-a5d71240-86f4-4fa5-9195-50865b8a8a56 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:50 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-defe8b50-a609-46c7-a3a0-cd0ea29aa2a8 req-a5d71240-86f4-4fa5-9195-50865b8a8a56 service nova] Creating event network-changed:1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance a075e35f-c43c-4e3a-adb2-2e1629079d93 on user Apr 14 17:10:50 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-defe8b50-a609-46c7-a3a0-cd0ea29aa2a8 req-a5d71240-86f4-4fa5-9195-50865b8a8a56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028402 Apr 14 17:10:50 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 133/400] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:10:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 17:10:50 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-30e113a8-dde6-46dc-ac36-56ca4210eb70 req-29a4e672-7d02-4ba4-8f3c-ad2608cb19b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c01d750-5923-4b61-9f3a-17cf1142f0a5", "tag": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-30e113a8-dde6-46dc-ac36-56ca4210eb70 req-29a4e672-7d02-4ba4-8f3c-ad2608cb19b4 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-30e113a8-dde6-46dc-ac36-56ca4210eb70 req-29a4e672-7d02-4ba4-8f3c-ad2608cb19b4 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-30e113a8-dde6-46dc-ac36-56ca4210eb70 req-29a4e672-7d02-4ba4-8f3c-ad2608cb19b4 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:50 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-30e113a8-dde6-46dc-ac36-56ca4210eb70 req-29a4e672-7d02-4ba4-8f3c-ad2608cb19b4 service nova] Creating event network-changed:1d44e719-ffdb-40ff-8b17-bf5d79e1df7e for instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 on user Apr 14 17:10:50 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-30e113a8-dde6-46dc-ac36-56ca4210eb70 req-29a4e672-7d02-4ba4-8f3c-ad2608cb19b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029920 Apr 14 17:10:50 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 136/401] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:10:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:10:51 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-7290172a-6623-4afb-889a-d018ab32f28d req-234888b3-1c97-4bb4-af60-276246b27617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d1a580c-99da-46df-b02d-e2462d8ef26b", "tag": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:51 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-7290172a-6623-4afb-889a-d018ab32f28d req-234888b3-1c97-4bb4-af60-276246b27617 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:51 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-7290172a-6623-4afb-889a-d018ab32f28d req-234888b3-1c97-4bb4-af60-276246b27617 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:51 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-7290172a-6623-4afb-889a-d018ab32f28d req-234888b3-1c97-4bb4-af60-276246b27617 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:51 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-7290172a-6623-4afb-889a-d018ab32f28d req-234888b3-1c97-4bb4-af60-276246b27617 service nova] Creating event network-changed:cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b on user Apr 14 17:10:51 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-7290172a-6623-4afb-889a-d018ab32f28d req-234888b3-1c97-4bb4-af60-276246b27617 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035305 Apr 14 17:10:51 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 133/402] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:10:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:10:53 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-883796e5-75be-4ae3-90e7-74530b0543ca req-dea2cab5-9516-4714-9690-8eb4c884872a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a075e35f-c43c-4e3a-adb2-2e1629079d93", "name": "network-vif-plugged", "status": "completed", "tag": "1477a3d2-85fc-4f05-83a0-156f88fc4939"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:53 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-883796e5-75be-4ae3-90e7-74530b0543ca req-dea2cab5-9516-4714-9690-8eb4c884872a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:53 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-883796e5-75be-4ae3-90e7-74530b0543ca req-dea2cab5-9516-4714-9690-8eb4c884872a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:53 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-883796e5-75be-4ae3-90e7-74530b0543ca req-dea2cab5-9516-4714-9690-8eb4c884872a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:53 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-883796e5-75be-4ae3-90e7-74530b0543ca req-dea2cab5-9516-4714-9690-8eb4c884872a service nova] Creating event network-vif-plugged:1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance a075e35f-c43c-4e3a-adb2-2e1629079d93 on user Apr 14 17:10:53 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-883796e5-75be-4ae3-90e7-74530b0543ca req-dea2cab5-9516-4714-9690-8eb4c884872a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057096 Apr 14 17:10:53 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 134/403] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:10:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:10:54 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-6712e22d-57d3-4c64-a040-9882f3b3ecdd req-755feb81-2d90-42c9-93fb-ee36dd81968c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c01d750-5923-4b61-9f3a-17cf1142f0a5", "name": "network-vif-plugged", "status": "completed", "tag": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-6712e22d-57d3-4c64-a040-9882f3b3ecdd req-755feb81-2d90-42c9-93fb-ee36dd81968c service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-6712e22d-57d3-4c64-a040-9882f3b3ecdd req-755feb81-2d90-42c9-93fb-ee36dd81968c service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-6712e22d-57d3-4c64-a040-9882f3b3ecdd req-755feb81-2d90-42c9-93fb-ee36dd81968c service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:54 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-6712e22d-57d3-4c64-a040-9882f3b3ecdd req-755feb81-2d90-42c9-93fb-ee36dd81968c service nova] Creating event network-vif-plugged:1d44e719-ffdb-40ff-8b17-bf5d79e1df7e for instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 on user Apr 14 17:10:54 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-6712e22d-57d3-4c64-a040-9882f3b3ecdd req-755feb81-2d90-42c9-93fb-ee36dd81968c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031605 Apr 14 17:10:54 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 137/404] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:10:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:10:55 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-48e0ce00-a5cb-425d-8cfc-9cea7e38782a req-71e7a518-2233-407d-b83d-624de992dc34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a075e35f-c43c-4e3a-adb2-2e1629079d93", "name": "network-vif-plugged", "status": "completed", "tag": "1477a3d2-85fc-4f05-83a0-156f88fc4939"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-48e0ce00-a5cb-425d-8cfc-9cea7e38782a req-71e7a518-2233-407d-b83d-624de992dc34 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-48e0ce00-a5cb-425d-8cfc-9cea7e38782a req-71e7a518-2233-407d-b83d-624de992dc34 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-48e0ce00-a5cb-425d-8cfc-9cea7e38782a req-71e7a518-2233-407d-b83d-624de992dc34 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:55 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-48e0ce00-a5cb-425d-8cfc-9cea7e38782a req-71e7a518-2233-407d-b83d-624de992dc34 service nova] Creating event network-vif-plugged:1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance a075e35f-c43c-4e3a-adb2-2e1629079d93 on user Apr 14 17:10:55 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-48e0ce00-a5cb-425d-8cfc-9cea7e38782a req-71e7a518-2233-407d-b83d-624de992dc34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035179 Apr 14 17:10:55 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 134/405] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:10:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:10:56 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-386afe8f-2cd5-48e8-ac9e-fbabf2cd8c80 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:56 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-386afe8f-2cd5-48e8-ac9e-fbabf2cd8c80 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-386afe8f-2cd5-48e8-ac9e-fbabf2cd8c80 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-386afe8f-2cd5-48e8-ac9e-fbabf2cd8c80 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-386afe8f-2cd5-48e8-ac9e-fbabf2cd8c80 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-386afe8f-2cd5-48e8-ac9e-fbabf2cd8c80 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-386afe8f-2cd5-48e8-ac9e-fbabf2cd8c80 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-386afe8f-2cd5-48e8-ac9e-fbabf2cd8c80 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:56 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-386afe8f-2cd5-48e8-ac9e-fbabf2cd8c80 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064329 Apr 14 17:10:56 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 135/406] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:10:56 2023] GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:10:56 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-7549eaa7-3dcb-4ea0-9877-8e0e55293190 req-f8dc9382-ac4b-4563-bbd2-2dcb0a1da8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c01d750-5923-4b61-9f3a-17cf1142f0a5", "name": "network-vif-plugged", "status": "completed", "tag": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:10:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-7549eaa7-3dcb-4ea0-9877-8e0e55293190 req-f8dc9382-ac4b-4563-bbd2-2dcb0a1da8c4 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-7549eaa7-3dcb-4ea0-9877-8e0e55293190 req-f8dc9382-ac4b-4563-bbd2-2dcb0a1da8c4 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-7549eaa7-3dcb-4ea0-9877-8e0e55293190 req-f8dc9382-ac4b-4563-bbd2-2dcb0a1da8c4 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:56 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-7549eaa7-3dcb-4ea0-9877-8e0e55293190 req-f8dc9382-ac4b-4563-bbd2-2dcb0a1da8c4 service nova] Creating event network-vif-plugged:1d44e719-ffdb-40ff-8b17-bf5d79e1df7e for instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 on user Apr 14 17:10:56 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-7549eaa7-3dcb-4ea0-9877-8e0e55293190 req-f8dc9382-ac4b-4563-bbd2-2dcb0a1da8c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062073 Apr 14 17:10:56 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 138/407] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:10:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:10:57 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:57 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-5313f9df-dfc0-48ee-adf9-28a995e5674f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:57 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-5313f9df-dfc0-48ee-adf9-28a995e5674f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:57 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5313f9df-dfc0-48ee-adf9-28a995e5674f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5313f9df-dfc0-48ee-adf9-28a995e5674f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5313f9df-dfc0-48ee-adf9-28a995e5674f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5313f9df-dfc0-48ee-adf9-28a995e5674f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5313f9df-dfc0-48ee-adf9-28a995e5674f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5313f9df-dfc0-48ee-adf9-28a995e5674f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:57 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b4d2fb6a-2d89-4c1e-8976-0a4689b5361d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:57 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-b4d2fb6a-2d89-4c1e-8976-0a4689b5361d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:57 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:57 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=8 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:10:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b4d2fb6a-2d89-4c1e-8976-0a4689b5361d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b4d2fb6a-2d89-4c1e-8976-0a4689b5361d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b4d2fb6a-2d89-4c1e-8976-0a4689b5361d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b4d2fb6a-2d89-4c1e-8976-0a4689b5361d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b4d2fb6a-2d89-4c1e-8976-0a4689b5361d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b4d2fb6a-2d89-4c1e-8976-0a4689b5361d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:57 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-5313f9df-dfc0-48ee-adf9-28a995e5674f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:10:57 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-5313f9df-dfc0-48ee-adf9-28a995e5674f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1656 microversion: 2.1 time: 0.275827 Apr 14 17:10:57 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 135/408] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:10:57 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1656 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:10:58 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-553e16b3-a2fd-4177-bb19-17cea437e687 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:10:58 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-553e16b3-a2fd-4177-bb19-17cea437e687 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:10:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-553e16b3-a2fd-4177-bb19-17cea437e687 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-553e16b3-a2fd-4177-bb19-17cea437e687 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-553e16b3-a2fd-4177-bb19-17cea437e687 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-553e16b3-a2fd-4177-bb19-17cea437e687 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:10:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-553e16b3-a2fd-4177-bb19-17cea437e687 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:10:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-553e16b3-a2fd-4177-bb19-17cea437e687 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:10:58 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-553e16b3-a2fd-4177-bb19-17cea437e687 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:10:58 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-553e16b3-a2fd-4177-bb19-17cea437e687 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1656 microversion: 2.1 time: 0.170518 Apr 14 17:10:58 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 139/409] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:10:58 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1656 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:10:58 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-b4d2fb6a-2d89-4c1e-8976-0a4689b5361d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c9e0d318eb4ca49d47d620682fb00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f341a2096b9483787b569a59f325556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:10:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-b4d2fb6a-2d89-4c1e-8976-0a4689b5361d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac" status: 200 len: 1545 microversion: 2.1 time: 0.328631 Apr 14 17:10:58 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 136/410] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:10:57 2023] GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac => generated 1545 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:11:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-1769f13f-d98e-40ea-9df7-87ecb8d05483 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '.version_select at 0x7fe19d0fb910>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:11:01 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=8 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:11:01 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-1769f13f-d98e-40ea-9df7-87ecb8d05483 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/76d1cc2c-f73e-47b3-a798-4adb640ecdc8" status: 204 len: 0 microversion: 2.1 time: 0.359337 Apr 14 17:11:01 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 136/411] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:11:01 2023] DELETE /compute/v2.1/images/76d1cc2c-f73e-47b3-a798-4adb640ecdc8 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:11:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:11:01 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:11:01 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:11:01 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=8 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:11:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:01 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Going to try to terminate instance {{(pid=61935) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:11:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-02b6797c-06a8-426b-8e76-88264caede5e tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd" status: 204 len: 0 microversion: 2.1 time: 0.133958 Apr 14 17:11:02 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 140/412] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:11:01 2023] DELETE /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:11:02 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-8287cfa3-a2bd-43ab-ac36-8b628bdd57a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:11:02 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-8287cfa3-a2bd-43ab-ac36-8b628bdd57a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:11:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8287cfa3-a2bd-43ab-ac36-8b628bdd57a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8287cfa3-a2bd-43ab-ac36-8b628bdd57a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8287cfa3-a2bd-43ab-ac36-8b628bdd57a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8287cfa3-a2bd-43ab-ac36-8b628bdd57a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8287cfa3-a2bd-43ab-ac36-8b628bdd57a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8287cfa3-a2bd-43ab-ac36-8b628bdd57a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:02 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-1a7cb8cb-f786-41da-ab66-4d1e61ff8823 req-38287e98-a423-4c50-9f7c-64b3a94e1dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5920661-9030-4cf7-88a0-1ad789eec1bd", "name": "network-vif-unplugged", "status": "completed", "tag": "526282d7-c5ce-4ae0-9745-4e43477222f0"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:11:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-1a7cb8cb-f786-41da-ab66-4d1e61ff8823 req-38287e98-a423-4c50-9f7c-64b3a94e1dd0 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-1a7cb8cb-f786-41da-ab66-4d1e61ff8823 req-38287e98-a423-4c50-9f7c-64b3a94e1dd0 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-1a7cb8cb-f786-41da-ab66-4d1e61ff8823 req-38287e98-a423-4c50-9f7c-64b3a94e1dd0 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:02 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-1a7cb8cb-f786-41da-ab66-4d1e61ff8823 req-38287e98-a423-4c50-9f7c-64b3a94e1dd0 service nova] Creating event network-vif-unplugged:526282d7-c5ce-4ae0-9745-4e43477222f0 for instance d5920661-9030-4cf7-88a0-1ad789eec1bd on user Apr 14 17:11:02 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-1a7cb8cb-f786-41da-ab66-4d1e61ff8823 req-38287e98-a423-4c50-9f7c-64b3a94e1dd0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034444 Apr 14 17:11:02 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 137/413] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:11:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:11:02 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-8287cfa3-a2bd-43ab-ac36-8b628bdd57a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d67df67ba8e4905bf7c6545c5748a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2764eee6c4071b5607f78762ca653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:11:02 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-8287cfa3-a2bd-43ab-ac36-8b628bdd57a5 tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd" status: 200 len: 1678 microversion: 2.1 time: 0.356638 Apr 14 17:11:02 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 137/414] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:11:02 2023] GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd => generated 1678 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:11:04 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-5450fff7-1b70-4498-99bd-7505476444a8 req-7559000d-93e1-4e34-a0e4-d220e5432a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5920661-9030-4cf7-88a0-1ad789eec1bd", "name": "network-vif-plugged", "status": "completed", "tag": "526282d7-c5ce-4ae0-9745-4e43477222f0"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:11:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5450fff7-1b70-4498-99bd-7505476444a8 req-7559000d-93e1-4e34-a0e4-d220e5432a73 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5450fff7-1b70-4498-99bd-7505476444a8 req-7559000d-93e1-4e34-a0e4-d220e5432a73 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5450fff7-1b70-4498-99bd-7505476444a8 req-7559000d-93e1-4e34-a0e4-d220e5432a73 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:04 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-5450fff7-1b70-4498-99bd-7505476444a8 req-7559000d-93e1-4e34-a0e4-d220e5432a73 service nova] Creating event network-vif-plugged:526282d7-c5ce-4ae0-9745-4e43477222f0 for instance d5920661-9030-4cf7-88a0-1ad789eec1bd on user Apr 14 17:11:04 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-5450fff7-1b70-4498-99bd-7505476444a8 req-7559000d-93e1-4e34-a0e4-d220e5432a73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037013 Apr 14 17:11:04 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 141/415] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:11:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:11:06 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1a580c-99da-46df-b02d-e2462d8ef26b", "name": "network-vif-plugged", "status": "completed", "tag": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d"}, {"server_uuid": "d5920661-9030-4cf7-88a0-1ad789eec1bd", "name": "network-vif-deleted", "tag": "526282d7-c5ce-4ae0-9745-4e43477222f0"}, {"server_uuid": "1d1a580c-99da-46df-b02d-e2462d8ef26b", "name": "network-vif-plugged", "status": "completed", "tag": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:11:06 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:06 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:06 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:06 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] Creating event network-vif-plugged:cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b on user Apr 14 17:11:06 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] Creating event network-vif-deleted:526282d7-c5ce-4ae0-9745-4e43477222f0 for instance d5920661-9030-4cf7-88a0-1ad789eec1bd on user Apr 14 17:11:06 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] Creating event network-vif-plugged:cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b on user Apr 14 17:11:06 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-da957eea-a5e7-4884-a3e7-dd2c2cbf608e req-cbaffb31-39ca-4bb7-a7b0-e450b93556e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.073385 Apr 14 17:11:06 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 138/416] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:11:06 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:11:08 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-35dfc9a0-e4b9-420f-8371-ff3eade4afd6 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-460993508", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b0124a46-3c94-42d9-9961-82730022fc5b", "destination_type": "local"}, {"source_type": "volume", "uuid": "72bdcc9d-f03f-4d21-b5b0-706b49331fc7", "destination_type": "invalid"}], "networks": [{"uuid": "bba4f725-673c-4e1a-a5bb-a435afc40332"}]}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:11:08 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-35dfc9a0-e4b9-420f-8371-ff3eade4afd6 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Request method failure captured: Apr 14 17:11:08 user devstack@n-api.service[61933]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 17:11:08 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:11:08 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:11:08 user devstack@n-api.service[61933]: Connection: close Apr 14 17:11:08 user devstack@n-api.service[61933]: Content-Length: 493 Apr 14 17:11:08 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:11:08 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:11:08 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:11:08 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:11:08 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYdeer58jEvUR9ADIlb0N430T-Ds21-KcdHVVoui-D_EAL5w5NtUAiByINleZljOdamOoVfvloz9qBpRKJNkBB-q3J2hMItuCYI1rvO5iZ-gzcRL6EYmrivLdXp9j61AUeL3LT7o_QloEQzxw1RchmjWXo1xX65gA6Tz8oI3QnBXw6g Apr 14 17:11:08 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:11:08 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:11:08 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:11:08 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:11:08 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:11:08 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:11:08 user devstack@n-api.service[61933]: X-Project-Id: 426156fb00db428683851cf731b680d1 Apr 14 17:11:08 user devstack@n-api.service[61933]: X-Project-Name: tempest-ServersNegativeTestJSON-1832599821 Apr 14 17:11:08 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:11:08 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:11:08 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426156fb00db428683851cf731b680d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426156fb00db428683851cf731b680d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/426156fb00db428683851cf731b680d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:11:08 user devstack@n-api.service[61933]: X-Tenant: tempest-ServersNegativeTestJSON-1832599821 Apr 14 17:11:08 user devstack@n-api.service[61933]: X-Tenant-Id: 426156fb00db428683851cf731b680d1 Apr 14 17:11:08 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832599821 Apr 14 17:11:08 user devstack@n-api.service[61933]: X-User: tempest-ServersNegativeTestJSON-1832599821-project-member Apr 14 17:11:08 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:11:08 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:11:08 user devstack@n-api.service[61933]: X-User-Id: 0d1ea0218b044c1e94f61a07c1d14a75 Apr 14 17:11:08 user devstack@n-api.service[61933]: X-User-Name: tempest-ServersNegativeTestJSON-1832599821-project-member Apr 14 17:11:08 user devstack@n-api.service[61933]: Apr 14 17:11:08 user devstack@n-api.service[61933]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-460993508", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b0124a46-3c94-42d9-9961-82730022fc5b", "destination_type": "local"}, {"source_type": "volume", "uuid": "72bdcc9d-f03f-4d21-b5b0-706b49331fc7", "destination_type": "invalid"}], "networks": [{"uuid": "bba4f725-673c-4e1a-a5bb-a435afc40332"}]}} Apr 14 17:11:08 user devstack@n-api.service[61933]: method: > Apr 14 17:11:08 user devstack@n-api.service[61933]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 17:11:08 user devstack@n-api.service[61933]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-460993508', 'imageRef': 'b0124a46-3c94-42d9-9961-82730022fc5b', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'b0124a46-3c94-42d9-9961-82730022fc5b', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '72bdcc9d-f03f-4d21-b5b0-706b49331fc7', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'bba4f725-673c-4e1a-a5bb-a435afc40332'}]}}} Apr 14 17:11:08 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise error Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi 'invalid' Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 17:11:08 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:08 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-35dfc9a0-e4b9-420f-8371-ff3eade4afd6 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:11:08 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-35dfc9a0-e4b9-420f-8371-ff3eade4afd6 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.010730 Apr 14 17:11:08 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 138/417] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:11:08 2023] POST /compute/v2.1/servers => generated 155 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:11:08 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-5350942f-1338-4cb0-a248-a45e7e5483ee tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:11:08 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-5350942f-1338-4cb0-a248-a45e7e5483ee tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:11:08 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5350942f-1338-4cb0-a248-a45e7e5483ee tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:08 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5350942f-1338-4cb0-a248-a45e7e5483ee tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:08 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5350942f-1338-4cb0-a248-a45e7e5483ee tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:08 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5350942f-1338-4cb0-a248-a45e7e5483ee tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:08 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5350942f-1338-4cb0-a248-a45e7e5483ee tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:08 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5350942f-1338-4cb0-a248-a45e7e5483ee tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:09 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-5350942f-1338-4cb0-a248-a45e7e5483ee tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1ea0218b044c1e94f61a07c1d14a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426156fb00db428683851cf731b680d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:11:09 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-5350942f-1338-4cb0-a248-a45e7e5483ee tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d" status: 200 len: 1492 microversion: 2.1 time: 0.348188 Apr 14 17:11:09 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 142/418] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:11:08 2023] GET /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d => generated 1492 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:11:11 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:11:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:11 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Going to try to start instance {{(pid=61934) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 17:11:11 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-40802f8a-3d9a-41f5-9554-1fc773fd1305 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97/action" status: 202 len: 0 microversion: 2.1 time: 0.071958 Apr 14 17:11:11 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 139/419] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:11:11 2023] POST /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:11:11 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-c65cdab0-24f1-43fa-bc0d-c10722878ce3 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:11:11 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-c65cdab0-24f1-43fa-bc0d-c10722878ce3 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:11:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c65cdab0-24f1-43fa-bc0d-c10722878ce3 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c65cdab0-24f1-43fa-bc0d-c10722878ce3 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c65cdab0-24f1-43fa-bc0d-c10722878ce3 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c65cdab0-24f1-43fa-bc0d-c10722878ce3 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c65cdab0-24f1-43fa-bc0d-c10722878ce3 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c65cdab0-24f1-43fa-bc0d-c10722878ce3 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:11 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-c65cdab0-24f1-43fa-bc0d-c10722878ce3 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c4734925f645248b0f9060aa78a502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8f6b39515e456c9f5a1affa9f79000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:11:11 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-c65cdab0-24f1-43fa-bc0d-c10722878ce3 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97" status: 200 len: 1650 microversion: 2.1 time: 0.223845 Apr 14 17:11:11 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 139/420] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:11:11 2023] GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97 => generated 1650 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:11:14 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-f1ea6467-78f5-4e16-b3a6-39095c16be12 req-f937dd9a-55c5-416f-9661-3750bb5cd327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "name": "network-vif-plugged", "status": "completed", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:11:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-f1ea6467-78f5-4e16-b3a6-39095c16be12 req-f937dd9a-55c5-416f-9661-3750bb5cd327 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-f1ea6467-78f5-4e16-b3a6-39095c16be12 req-f937dd9a-55c5-416f-9661-3750bb5cd327 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-f1ea6467-78f5-4e16-b3a6-39095c16be12 req-f937dd9a-55c5-416f-9661-3750bb5cd327 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:14 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-f1ea6467-78f5-4e16-b3a6-39095c16be12 req-f937dd9a-55c5-416f-9661-3750bb5cd327 service nova] Creating event network-vif-plugged:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:11:14 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-f1ea6467-78f5-4e16-b3a6-39095c16be12 req-f937dd9a-55c5-416f-9661-3750bb5cd327 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039329 Apr 14 17:11:14 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 143/421] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:11:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:11:16 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-ca8f2da7-a19e-4703-b3dd-17c54b59de22 req-05fcfce2-ef76-4606-8ea8-85afe6ada85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "name": "network-vif-plugged", "status": "completed", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:11:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ca8f2da7-a19e-4703-b3dd-17c54b59de22 req-05fcfce2-ef76-4606-8ea8-85afe6ada85a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ca8f2da7-a19e-4703-b3dd-17c54b59de22 req-05fcfce2-ef76-4606-8ea8-85afe6ada85a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ca8f2da7-a19e-4703-b3dd-17c54b59de22 req-05fcfce2-ef76-4606-8ea8-85afe6ada85a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:16 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-ca8f2da7-a19e-4703-b3dd-17c54b59de22 req-05fcfce2-ef76-4606-8ea8-85afe6ada85a service nova] Creating event network-vif-plugged:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:11:16 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-ca8f2da7-a19e-4703-b3dd-17c54b59de22 req-05fcfce2-ef76-4606-8ea8-85afe6ada85a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032274 Apr 14 17:11:16 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 140/422] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:11:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 17:11:21 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:11:21 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=30 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:11:21 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-104fb59e-124a-4464-b15f-fdb905e7faf1 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:11:21 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-104fb59e-124a-4464-b15f-fdb905e7faf1 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:11:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-104fb59e-124a-4464-b15f-fdb905e7faf1 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-104fb59e-124a-4464-b15f-fdb905e7faf1 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-104fb59e-124a-4464-b15f-fdb905e7faf1 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-104fb59e-124a-4464-b15f-fdb905e7faf1 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-104fb59e-124a-4464-b15f-fdb905e7faf1 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-104fb59e-124a-4464-b15f-fdb905e7faf1 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:22 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-104fb59e-124a-4464-b15f-fdb905e7faf1 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:11:22 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-104fb59e-124a-4464-b15f-fdb905e7faf1 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:11:22 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-104fb59e-124a-4464-b15f-fdb905e7faf1 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:11:22 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-104fb59e-124a-4464-b15f-fdb905e7faf1 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" status: 200 len: 1652 microversion: 2.20 time: 0.284971 Apr 14 17:11:22 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 140/423] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:11:21 2023] GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c => generated 1652 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:11:37 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:11:37 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:11:37 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-c2531ebf-791e-4121-b444-d7526fbb10b3 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:11:37 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-c2531ebf-791e-4121-b444-d7526fbb10b3 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:11:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c2531ebf-791e-4121-b444-d7526fbb10b3 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c2531ebf-791e-4121-b444-d7526fbb10b3 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c2531ebf-791e-4121-b444-d7526fbb10b3 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c2531ebf-791e-4121-b444-d7526fbb10b3 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c2531ebf-791e-4121-b444-d7526fbb10b3 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c2531ebf-791e-4121-b444-d7526fbb10b3 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:37 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-c2531ebf-791e-4121-b444-d7526fbb10b3 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:11:37 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-c2531ebf-791e-4121-b444-d7526fbb10b3 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c01d750-5923-4b61-9f3a-17cf1142f0a5" status: 200 len: 1503 microversion: 2.1 time: 0.262133 Apr 14 17:11:37 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 144/424] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:11:37 2023] GET /compute/v2.1/servers/5c01d750-5923-4b61-9f3a-17cf1142f0a5 => generated 1503 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:11:38 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=9 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:11:38 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:11:38 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-38e2c2d1-0390-40fd-8fb2-b508ff432101 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:11:38 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-38e2c2d1-0390-40fd-8fb2-b508ff432101 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:11:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-38e2c2d1-0390-40fd-8fb2-b508ff432101 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-38e2c2d1-0390-40fd-8fb2-b508ff432101 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-38e2c2d1-0390-40fd-8fb2-b508ff432101 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-38e2c2d1-0390-40fd-8fb2-b508ff432101 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-38e2c2d1-0390-40fd-8fb2-b508ff432101 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-38e2c2d1-0390-40fd-8fb2-b508ff432101 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:38 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-38e2c2d1-0390-40fd-8fb2-b508ff432101 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:11:38 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-38e2c2d1-0390-40fd-8fb2-b508ff432101 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:11:38 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-38e2c2d1-0390-40fd-8fb2-b508ff432101 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:11:38 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-38e2c2d1-0390-40fd-8fb2-b508ff432101 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b" status: 200 len: 1768 microversion: 2.87 time: 0.272180 Apr 14 17:11:38 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 141/425] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:11:38 2023] GET /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b => generated 1768 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:11:44 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-5a22e2db-1a0b-4001-841c-9a4052e66f69 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Action: 'create', calling method: .version_select at 0x7fe19ce0f0a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-117998537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkHn8KqahWz/emGYRiJYU1Ar7OMEHr0fKXPxwVqsrBJYhVMCBh85wSuaAQF08VJojn201q2dqjwBtsw0MZFjg4JdPSQQHLniZ0xwwDfoj5aANamtwnZYLGhGYaCVAnDJg=="}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:11:44 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:11:44 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:11:44 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-5a22e2db-1a0b-4001-841c-9a4052e66f69 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Getting quotas for project 0a92a4f922f442a88cfb86f8239e52ac. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:11:44 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-5a22e2db-1a0b-4001-841c-9a4052e66f69 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Getting quotas for user 4bd0842f11b0499298e2af46ad659962 and project 0a92a4f922f442a88cfb86f8239e52ac. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:11:44 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-5a22e2db-1a0b-4001-841c-9a4052e66f69 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049905 Apr 14 17:11:44 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 141/426] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 17:11:44 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:11:44 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1774561863", "imageRef": "2575725f-bb4e-408e-8718-10139aaf6e19", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-117998537", "networks": [{"uuid": "c5734dfe-c265-4d08-840a-4116e7574b53"}]}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:11:44 user devstack@n-api.service[61935]: DEBUG nova.network.neutron [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] validate_networks() for [('c5734dfe-c265-4d08-840a-4116e7574b53', None, None, None, None, None)] {{(pid=61935) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:11:45 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Flavor limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:11:45 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Image limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:11:45 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Flavor pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:11:45 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Image pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:11:45 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:11:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:45 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Getting quotas for project 0a92a4f922f442a88cfb86f8239e52ac. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:11:45 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Getting quotas for user 4bd0842f11b0499298e2af46ad659962 and project 0a92a4f922f442a88cfb86f8239e52ac. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:11:45 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Going to run 1 instances... {{(pid=61935) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:11:45 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2575725f-bb4e-408e-8718-10139aaf6e19',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:11:45 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-94813c03-edf4-4ea2-81f0-184d4cf21081 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.812054 Apr 14 17:11:45 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 145/427] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:11:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:11:45 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a6e332c7-fc03-4f15-b0ce-5fb6740e91c2 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:11:45 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-a6e332c7-fc03-4f15-b0ce-5fb6740e91c2 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:11:45 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-a6e332c7-fc03-4f15-b0ce-5fb6740e91c2 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:11:45 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-a6e332c7-fc03-4f15-b0ce-5fb6740e91c2 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5" status: 200 len: 1252 microversion: 2.1 time: 0.058374 Apr 14 17:11:45 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 142/428] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:11:45 2023] GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5 => generated 1252 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:11:48 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-7de18c28-4ed7-4f10-a4ef-0514f6c1037b req-2ee8b290-143e-43a9-a778-d1781e1e55df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35dee18b-ac00-4f46-813e-7a7b400cdba5", "tag": "4295b114-8b6f-42e4-97c3-d6f972188a25"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:11:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-7de18c28-4ed7-4f10-a4ef-0514f6c1037b req-2ee8b290-143e-43a9-a778-d1781e1e55df service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-7de18c28-4ed7-4f10-a4ef-0514f6c1037b req-2ee8b290-143e-43a9-a778-d1781e1e55df service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-7de18c28-4ed7-4f10-a4ef-0514f6c1037b req-2ee8b290-143e-43a9-a778-d1781e1e55df service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:48 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-7de18c28-4ed7-4f10-a4ef-0514f6c1037b req-2ee8b290-143e-43a9-a778-d1781e1e55df service nova] Creating event network-changed:4295b114-8b6f-42e4-97c3-d6f972188a25 for instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 on user Apr 14 17:11:48 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-7de18c28-4ed7-4f10-a4ef-0514f6c1037b req-2ee8b290-143e-43a9-a778-d1781e1e55df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047131 Apr 14 17:11:48 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 142/429] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:11:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:11:50 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-e77634ad-2bcf-4343-8f39-3b6bb25403fe req-f255b5ef-2c26-4129-9448-2115424c548f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dee18b-ac00-4f46-813e-7a7b400cdba5", "name": "network-vif-plugged", "status": "completed", "tag": "4295b114-8b6f-42e4-97c3-d6f972188a25"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:11:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-e77634ad-2bcf-4343-8f39-3b6bb25403fe req-f255b5ef-2c26-4129-9448-2115424c548f service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-e77634ad-2bcf-4343-8f39-3b6bb25403fe req-f255b5ef-2c26-4129-9448-2115424c548f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-e77634ad-2bcf-4343-8f39-3b6bb25403fe req-f255b5ef-2c26-4129-9448-2115424c548f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:50 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-e77634ad-2bcf-4343-8f39-3b6bb25403fe req-f255b5ef-2c26-4129-9448-2115424c548f service nova] Creating event network-vif-plugged:4295b114-8b6f-42e4-97c3-d6f972188a25 for instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 on user Apr 14 17:11:50 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-e77634ad-2bcf-4343-8f39-3b6bb25403fe req-f255b5ef-2c26-4129-9448-2115424c548f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038494 Apr 14 17:11:50 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 146/430] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:11:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:11:52 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-7e2bfebe-5621-4d74-9647-6edd2dfa872c req-45fd3708-b1ae-40ca-b1f3-08102c67fb84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dee18b-ac00-4f46-813e-7a7b400cdba5", "name": "network-vif-plugged", "status": "completed", "tag": "4295b114-8b6f-42e4-97c3-d6f972188a25"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:11:52 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:11:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-7e2bfebe-5621-4d74-9647-6edd2dfa872c req-45fd3708-b1ae-40ca-b1f3-08102c67fb84 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-7e2bfebe-5621-4d74-9647-6edd2dfa872c req-45fd3708-b1ae-40ca-b1f3-08102c67fb84 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-7e2bfebe-5621-4d74-9647-6edd2dfa872c req-45fd3708-b1ae-40ca-b1f3-08102c67fb84 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:52 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-7e2bfebe-5621-4d74-9647-6edd2dfa872c req-45fd3708-b1ae-40ca-b1f3-08102c67fb84 service nova] Creating event network-vif-plugged:4295b114-8b6f-42e4-97c3-d6f972188a25 for instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 on user Apr 14 17:11:52 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-7e2bfebe-5621-4d74-9647-6edd2dfa872c req-45fd3708-b1ae-40ca-b1f3-08102c67fb84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035452 Apr 14 17:11:52 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 143/431] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:11:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:11:52 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-1a04015a-84ca-413a-aa47-02fc704e0d2f tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:11:52 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-1a04015a-84ca-413a-aa47-02fc704e0d2f tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] [instance: d5920661-9030-4cf7-88a0-1ad789eec1bd] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:11:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1a04015a-84ca-413a-aa47-02fc704e0d2f tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1a04015a-84ca-413a-aa47-02fc704e0d2f tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1a04015a-84ca-413a-aa47-02fc704e0d2f tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1a04015a-84ca-413a-aa47-02fc704e0d2f tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1a04015a-84ca-413a-aa47-02fc704e0d2f tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1a04015a-84ca-413a-aa47-02fc704e0d2f tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:52 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-1a04015a-84ca-413a-aa47-02fc704e0d2f tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] HTTP exception thrown: Instance d5920661-9030-4cf7-88a0-1ad789eec1bd could not be found. Apr 14 17:11:52 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-1a04015a-84ca-413a-aa47-02fc704e0d2f tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Request method failure captured: Apr 14 17:11:52 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd HTTP/1.1 Apr 14 17:11:52 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:11:52 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:11:52 user devstack@n-api.service[61933]: Connection: close Apr 14 17:11:52 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:11:52 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:11:52 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:11:52 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:11:52 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:11:52 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYdhhe5uKYXXrL5yGy2uG0HxtNNycruUP_esuNg6YbNwdcMvbu5Q1IoWkdvZTPjYO5-BJobe9A4w4MzVtw9zDT2jkUq701VVPxezWXDo3wvo1mBrlTq210Bak1AEK_r9pOKUiWRnynJcHGKRGOpwjNzfcUtukyz6XQN1Y6OVWgbJ4rs Apr 14 17:11:52 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:11:52 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:11:52 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:11:52 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:11:52 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:11:52 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:11:52 user devstack@n-api.service[61933]: X-Project-Id: 7fa2764eee6c4071b5607f78762ca653 Apr 14 17:11:52 user devstack@n-api.service[61933]: X-Project-Name: tempest-ServerStableDeviceRescueTest-363765322 Apr 14 17:11:52 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:11:52 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:11:52 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7fa2764eee6c4071b5607f78762ca653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7fa2764eee6c4071b5607f78762ca653"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7fa2764eee6c4071b5607f78762ca653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:11:52 user devstack@n-api.service[61933]: X-Tenant: tempest-ServerStableDeviceRescueTest-363765322 Apr 14 17:11:52 user devstack@n-api.service[61933]: X-Tenant-Id: 7fa2764eee6c4071b5607f78762ca653 Apr 14 17:11:52 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-363765322 Apr 14 17:11:52 user devstack@n-api.service[61933]: X-User: tempest-ServerStableDeviceRescueTest-363765322-project-member Apr 14 17:11:52 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:11:52 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:11:52 user devstack@n-api.service[61933]: X-User-Id: 1d67df67ba8e4905bf7c6545c5748a41 Apr 14 17:11:52 user devstack@n-api.service[61933]: X-User-Name: tempest-ServerStableDeviceRescueTest-363765322-project-member Apr 14 17:11:52 user devstack@n-api.service[61933]: method: > Apr 14 17:11:52 user devstack@n-api.service[61933]: exception: Instance d5920661-9030-4cf7-88a0-1ad789eec1bd could not be found. Apr 14 17:11:52 user devstack@n-api.service[61933]: action_args: {'id': 'd5920661-9030-4cf7-88a0-1ad789eec1bd'} Apr 14 17:11:52 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5920661-9030-4cf7-88a0-1ad789eec1bd could not be found. Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5920661-9030-4cf7-88a0-1ad789eec1bd could not be found. Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5920661-9030-4cf7-88a0-1ad789eec1bd could not be found. Apr 14 17:11:52 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:52 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-1a04015a-84ca-413a-aa47-02fc704e0d2f tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Returning 404 to user: Instance d5920661-9030-4cf7-88a0-1ad789eec1bd could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:11:52 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-1a04015a-84ca-413a-aa47-02fc704e0d2f tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd" status: 404 len: 111 microversion: 2.1 time: 0.028106 Apr 14 17:11:52 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 143/432] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:11:52 2023] GET /compute/v2.1/servers/d5920661-9030-4cf7-88a0-1ad789eec1bd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:11:52 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-4acbcde9-6631-4b34-a992-cb7e156598ab tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] Calling method '.version_select at 0x7fe19ce9d870>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:11:52 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-4acbcde9-6631-4b34-a992-cb7e156598ab tempest-ServerStableDeviceRescueTest-363765322 tempest-ServerStableDeviceRescueTest-363765322-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1270943457" status: 202 len: 0 microversion: 2.1 time: 0.026120 Apr 14 17:11:52 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 147/433] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 17:11:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1270943457 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:11:57 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:11:57 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-15b50d50-5652-428d-a475-2a598acf6ea7 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] Action: 'create', calling method: .version_select at 0x7fe19cfc6f80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-862033926", "metadata": {"Type": "work"}}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:11:57 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-15b50d50-5652-428d-a475-2a598acf6ea7 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] Request method failure captured: Apr 14 17:11:57 user devstack@n-api.service[61934]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 17:11:57 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:11:57 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:11:57 user devstack@n-api.service[61934]: Connection: close Apr 14 17:11:57 user devstack@n-api.service[61934]: Content-Length: 121 Apr 14 17:11:57 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:11:57 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:11:57 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:11:57 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYldMm7O_ArNTtMIWnkLId-OFdysIj-9pdanFAj9e5ozTh2MtuxYL0h-CX7kCla9PwOqVsA_gpkoL3zppqdJUNMaCwB58-khG3QgJlvFUi0QPtSDiWxjxwkf3OQZNA_c4NCr0V4FqR12QiyQ13zk4jMQkLl-T2QxBtv0l31KEDklAts Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Project-Id: 5f6ad9fff2464e7f9a48ae7e7bb430b7 Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Project-Name: tempest-VolumesNegativeTest-1281249132 Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f6ad9fff2464e7f9a48ae7e7bb430b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f6ad9fff2464e7f9a48ae7e7bb430b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5f6ad9fff2464e7f9a48ae7e7bb430b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Tenant: tempest-VolumesNegativeTest-1281249132 Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Tenant-Id: 5f6ad9fff2464e7f9a48ae7e7bb430b7 Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-VolumesNegativeTest-1281249132 Apr 14 17:11:57 user devstack@n-api.service[61934]: X-User: tempest-VolumesNegativeTest-1281249132-project-member Apr 14 17:11:57 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:11:57 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:11:57 user devstack@n-api.service[61934]: X-User-Id: f659cbd3d9434f979fb51f5b3c4737bb Apr 14 17:11:57 user devstack@n-api.service[61934]: X-User-Name: tempest-VolumesNegativeTest-1281249132-project-member Apr 14 17:11:57 user devstack@n-api.service[61934]: Apr 14 17:11:57 user devstack@n-api.service[61934]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-862033926", "metadata": {"Type": "work"}}} Apr 14 17:11:57 user devstack@n-api.service[61934]: method: Apr 14 17:11:57 user devstack@n-api.service[61934]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 17:11:57 user devstack@n-api.service[61934]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-862033926', 'metadata': {'Type': 'work'}}}} Apr 14 17:11:57 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise error Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi '#$%' Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-15b50d50-5652-428d-a475-2a598acf6ea7 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:11:57 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-15b50d50-5652-428d-a475-2a598acf6ea7 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.172140 Apr 14 17:11:57 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 144/434] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 17:11:57 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:11:57 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-3da2f9e2-68be-4723-b86d-a7ba678a5dd9 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] Action: 'create', calling method: .version_select at 0x7fe19d07ff40>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1521861910", "metadata": {"Type": "work"}}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:11:57 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-3da2f9e2-68be-4723-b86d-a7ba678a5dd9 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] Request method failure captured: Apr 14 17:11:57 user devstack@n-api.service[61933]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 17:11:57 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:11:57 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:11:57 user devstack@n-api.service[61933]: Connection: close Apr 14 17:11:57 user devstack@n-api.service[61933]: Content-Length: 120 Apr 14 17:11:57 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:11:57 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:11:57 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:11:57 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYldMm7O_ArNTtMIWnkLId-OFdysIj-9pdanFAj9e5ozTh2MtuxYL0h-CX7kCla9PwOqVsA_gpkoL3zppqdJUNMaCwB58-khG3QgJlvFUi0QPtSDiWxjxwkf3OQZNA_c4NCr0V4FqR12QiyQ13zk4jMQkLl-T2QxBtv0l31KEDklAts Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Project-Id: 5f6ad9fff2464e7f9a48ae7e7bb430b7 Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Project-Name: tempest-VolumesNegativeTest-1281249132 Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f6ad9fff2464e7f9a48ae7e7bb430b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f6ad9fff2464e7f9a48ae7e7bb430b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5f6ad9fff2464e7f9a48ae7e7bb430b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Tenant: tempest-VolumesNegativeTest-1281249132 Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Tenant-Id: 5f6ad9fff2464e7f9a48ae7e7bb430b7 Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-VolumesNegativeTest-1281249132 Apr 14 17:11:57 user devstack@n-api.service[61933]: X-User: tempest-VolumesNegativeTest-1281249132-project-member Apr 14 17:11:57 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:11:57 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:11:57 user devstack@n-api.service[61933]: X-User-Id: f659cbd3d9434f979fb51f5b3c4737bb Apr 14 17:11:57 user devstack@n-api.service[61933]: X-User-Name: tempest-VolumesNegativeTest-1281249132-project-member Apr 14 17:11:57 user devstack@n-api.service[61933]: Apr 14 17:11:57 user devstack@n-api.service[61933]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1521861910", "metadata": {"Type": "work"}}} Apr 14 17:11:57 user devstack@n-api.service[61933]: method: Apr 14 17:11:57 user devstack@n-api.service[61933]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 17:11:57 user devstack@n-api.service[61933]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1521861910', 'metadata': {'Type': 'work'}}}} Apr 14 17:11:57 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise error Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi '0' Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-3da2f9e2-68be-4723-b86d-a7ba678a5dd9 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:11:57 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-3da2f9e2-68be-4723-b86d-a7ba678a5dd9 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010061 Apr 14 17:11:57 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 144/435] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 17:11:57 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:11:57 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:11:57 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:11:57 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-9619eff1-8aa4-4f61-8728-b0a8e6c1718c tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] Action: 'create', calling method: .version_select at 0x7fe19ce9e320>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1963875122", "metadata": {"Type": "work"}}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:11:57 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-9619eff1-8aa4-4f61-8728-b0a8e6c1718c tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] Request method failure captured: Apr 14 17:11:57 user devstack@n-api.service[61935]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 17:11:57 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:11:57 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:11:57 user devstack@n-api.service[61935]: Connection: close Apr 14 17:11:57 user devstack@n-api.service[61935]: Content-Length: 119 Apr 14 17:11:57 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:11:57 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:11:57 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:11:57 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:11:57 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYldMm7O_ArNTtMIWnkLId-OFdysIj-9pdanFAj9e5ozTh2MtuxYL0h-CX7kCla9PwOqVsA_gpkoL3zppqdJUNMaCwB58-khG3QgJlvFUi0QPtSDiWxjxwkf3OQZNA_c4NCr0V4FqR12QiyQ13zk4jMQkLl-T2QxBtv0l31KEDklAts Apr 14 17:11:57 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:11:57 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:11:57 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:11:57 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:11:57 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:11:57 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:11:57 user devstack@n-api.service[61935]: X-Project-Id: 5f6ad9fff2464e7f9a48ae7e7bb430b7 Apr 14 17:11:57 user devstack@n-api.service[61935]: X-Project-Name: tempest-VolumesNegativeTest-1281249132 Apr 14 17:11:57 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:11:57 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:11:57 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f6ad9fff2464e7f9a48ae7e7bb430b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f6ad9fff2464e7f9a48ae7e7bb430b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5f6ad9fff2464e7f9a48ae7e7bb430b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:11:57 user devstack@n-api.service[61935]: X-Tenant: tempest-VolumesNegativeTest-1281249132 Apr 14 17:11:57 user devstack@n-api.service[61935]: X-Tenant-Id: 5f6ad9fff2464e7f9a48ae7e7bb430b7 Apr 14 17:11:57 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-VolumesNegativeTest-1281249132 Apr 14 17:11:57 user devstack@n-api.service[61935]: X-User: tempest-VolumesNegativeTest-1281249132-project-member Apr 14 17:11:57 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:11:57 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:11:57 user devstack@n-api.service[61935]: X-User-Id: f659cbd3d9434f979fb51f5b3c4737bb Apr 14 17:11:57 user devstack@n-api.service[61935]: X-User-Name: tempest-VolumesNegativeTest-1281249132-project-member Apr 14 17:11:57 user devstack@n-api.service[61935]: Apr 14 17:11:57 user devstack@n-api.service[61935]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1963875122", "metadata": {"Type": "work"}}} Apr 14 17:11:57 user devstack@n-api.service[61935]: method: Apr 14 17:11:57 user devstack@n-api.service[61935]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 17:11:57 user devstack@n-api.service[61935]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1963875122', 'metadata': {'Type': 'work'}}}} Apr 14 17:11:57 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise error Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi '' Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 17:11:57 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-9619eff1-8aa4-4f61-8728-b0a8e6c1718c tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:11:57 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-9619eff1-8aa4-4f61-8728-b0a8e6c1718c tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015966 Apr 14 17:11:57 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 148/436] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 17:11:57 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 14 17:11:57 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-be6fc720-1246-4e24-b360-7a27ef4cf335 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] Calling method '.version_select at 0x7fe19d3cb130>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:11:57 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-be6fc720-1246-4e24-b360-7a27ef4cf335 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] HTTP exception thrown: Volume tempest-invalid-1080844804 could not be found. Apr 14 17:11:57 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-be6fc720-1246-4e24-b360-7a27ef4cf335 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] Request method failure captured: Apr 14 17:11:57 user devstack@n-api.service[61934]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1080844804 HTTP/1.1 Apr 14 17:11:57 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:11:57 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:11:57 user devstack@n-api.service[61934]: Connection: close Apr 14 17:11:57 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:11:57 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:11:57 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:11:57 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:11:57 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYldMm7O_ArNTtMIWnkLId-OFdysIj-9pdanFAj9e5ozTh2MtuxYL0h-CX7kCla9PwOqVsA_gpkoL3zppqdJUNMaCwB58-khG3QgJlvFUi0QPtSDiWxjxwkf3OQZNA_c4NCr0V4FqR12QiyQ13zk4jMQkLl-T2QxBtv0l31KEDklAts Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Project-Id: 5f6ad9fff2464e7f9a48ae7e7bb430b7 Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Project-Name: tempest-VolumesNegativeTest-1281249132 Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f6ad9fff2464e7f9a48ae7e7bb430b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f6ad9fff2464e7f9a48ae7e7bb430b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5f6ad9fff2464e7f9a48ae7e7bb430b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Tenant: tempest-VolumesNegativeTest-1281249132 Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Tenant-Id: 5f6ad9fff2464e7f9a48ae7e7bb430b7 Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-VolumesNegativeTest-1281249132 Apr 14 17:11:57 user devstack@n-api.service[61934]: X-User: tempest-VolumesNegativeTest-1281249132-project-member Apr 14 17:11:57 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:11:57 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:11:57 user devstack@n-api.service[61934]: X-User-Id: f659cbd3d9434f979fb51f5b3c4737bb Apr 14 17:11:57 user devstack@n-api.service[61934]: X-User-Name: tempest-VolumesNegativeTest-1281249132-project-member Apr 14 17:11:57 user devstack@n-api.service[61934]: method: Apr 14 17:11:57 user devstack@n-api.service[61934]: exception: Volume tempest-invalid-1080844804 could not be found. Apr 14 17:11:57 user devstack@n-api.service[61934]: action_args: {'id': 'tempest-invalid-1080844804'} Apr 14 17:11:57 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1080844804 could not be found. (HTTP 404) (Request-ID: req-e8c7e5be-bff4-47cb-9bcc-7d5742d6e757) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1080844804 could not be found. Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1080844804 could not be found. Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1080844804 could not be found. Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-be6fc720-1246-4e24-b360-7a27ef4cf335 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] Returning 404 to user: Volume tempest-invalid-1080844804 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:11:57 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-be6fc720-1246-4e24-b360-7a27ef4cf335 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1080844804" status: 404 len: 99 microversion: 2.1 time: 0.039290 Apr 14 17:11:57 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 145/437] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 17:11:57 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1080844804 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 14 17:11:57 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:11:57 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-c0a2791d-78c9-4cb0-8eab-a9a3d969c6e7 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008190 Apr 14 17:11:57 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 145/438] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 17:11:57 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 17:11:57 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-9ed3f835-2aba-434a-b91a-a2feb3813a96 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009144 Apr 14 17:11:57 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 149/439] 10.0.0.210 () {62 vars in 1214 bytes} [Fri Apr 14 17:11:57 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 17:11:57 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-bf3c3ce9-d4e4-4e81-9eb5-5cdf4b9b22b5 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] Calling method '.version_select at 0x7fe19cfc6170>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:11:57 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-bf3c3ce9-d4e4-4e81-9eb5-5cdf4b9b22b5 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] HTTP exception thrown: Volume 7e693425-a4ef-4ee9-b832-0aff769a23bb could not be found. Apr 14 17:11:57 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-bf3c3ce9-d4e4-4e81-9eb5-5cdf4b9b22b5 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] Request method failure captured: Apr 14 17:11:57 user devstack@n-api.service[61934]: request: DELETE /compute/v2.1/os-volumes/7e693425-a4ef-4ee9-b832-0aff769a23bb HTTP/1.1 Apr 14 17:11:57 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:11:57 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:11:57 user devstack@n-api.service[61934]: Connection: close Apr 14 17:11:57 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:11:57 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:11:57 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:11:57 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:11:57 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYldMm7O_ArNTtMIWnkLId-OFdysIj-9pdanFAj9e5ozTh2MtuxYL0h-CX7kCla9PwOqVsA_gpkoL3zppqdJUNMaCwB58-khG3QgJlvFUi0QPtSDiWxjxwkf3OQZNA_c4NCr0V4FqR12QiyQ13zk4jMQkLl-T2QxBtv0l31KEDklAts Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Project-Id: 5f6ad9fff2464e7f9a48ae7e7bb430b7 Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Project-Name: tempest-VolumesNegativeTest-1281249132 Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f6ad9fff2464e7f9a48ae7e7bb430b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f6ad9fff2464e7f9a48ae7e7bb430b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5f6ad9fff2464e7f9a48ae7e7bb430b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Tenant: tempest-VolumesNegativeTest-1281249132 Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Tenant-Id: 5f6ad9fff2464e7f9a48ae7e7bb430b7 Apr 14 17:11:57 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-VolumesNegativeTest-1281249132 Apr 14 17:11:57 user devstack@n-api.service[61934]: X-User: tempest-VolumesNegativeTest-1281249132-project-member Apr 14 17:11:57 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:11:57 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:11:57 user devstack@n-api.service[61934]: X-User-Id: f659cbd3d9434f979fb51f5b3c4737bb Apr 14 17:11:57 user devstack@n-api.service[61934]: X-User-Name: tempest-VolumesNegativeTest-1281249132-project-member Apr 14 17:11:57 user devstack@n-api.service[61934]: method: Apr 14 17:11:57 user devstack@n-api.service[61934]: exception: Volume 7e693425-a4ef-4ee9-b832-0aff769a23bb could not be found. Apr 14 17:11:57 user devstack@n-api.service[61934]: action_args: {'id': '7e693425-a4ef-4ee9-b832-0aff769a23bb'} Apr 14 17:11:57 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e693425-a4ef-4ee9-b832-0aff769a23bb could not be found. (HTTP 404) (Request-ID: req-d112faa4-4408-4714-8006-c2c626a0eb36) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e693425-a4ef-4ee9-b832-0aff769a23bb could not be found. Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e693425-a4ef-4ee9-b832-0aff769a23bb could not be found. Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e693425-a4ef-4ee9-b832-0aff769a23bb could not be found. Apr 14 17:11:57 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-bf3c3ce9-d4e4-4e81-9eb5-5cdf4b9b22b5 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] Returning 404 to user: Volume 7e693425-a4ef-4ee9-b832-0aff769a23bb could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:11:57 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-bf3c3ce9-d4e4-4e81-9eb5-5cdf4b9b22b5 tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/7e693425-a4ef-4ee9-b832-0aff769a23bb" status: 404 len: 109 microversion: 2.1 time: 0.034385 Apr 14 17:11:57 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 146/440] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 17:11:57 2023] DELETE /compute/v2.1/os-volumes/7e693425-a4ef-4ee9-b832-0aff769a23bb => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:11:57 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-945e9945-fec6-47d4-a1fc-db62459d63ca tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] Calling method '.version_select at 0x7fe19ce0f010>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:11:57 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-945e9945-fec6-47d4-a1fc-db62459d63ca tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] HTTP exception thrown: Volume 9fa3605c-d103-4777-b9b9-9e3b1546b4ce could not be found. Apr 14 17:11:57 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-945e9945-fec6-47d4-a1fc-db62459d63ca tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] Request method failure captured: Apr 14 17:11:57 user devstack@n-api.service[61933]: request: GET /compute/v2.1/os-volumes/9fa3605c-d103-4777-b9b9-9e3b1546b4ce HTTP/1.1 Apr 14 17:11:57 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:11:57 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:11:57 user devstack@n-api.service[61933]: Connection: close Apr 14 17:11:57 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:11:57 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:11:57 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:11:57 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:11:57 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYldMm7O_ArNTtMIWnkLId-OFdysIj-9pdanFAj9e5ozTh2MtuxYL0h-CX7kCla9PwOqVsA_gpkoL3zppqdJUNMaCwB58-khG3QgJlvFUi0QPtSDiWxjxwkf3OQZNA_c4NCr0V4FqR12QiyQ13zk4jMQkLl-T2QxBtv0l31KEDklAts Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Project-Id: 5f6ad9fff2464e7f9a48ae7e7bb430b7 Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Project-Name: tempest-VolumesNegativeTest-1281249132 Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f6ad9fff2464e7f9a48ae7e7bb430b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f6ad9fff2464e7f9a48ae7e7bb430b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5f6ad9fff2464e7f9a48ae7e7bb430b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Tenant: tempest-VolumesNegativeTest-1281249132 Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Tenant-Id: 5f6ad9fff2464e7f9a48ae7e7bb430b7 Apr 14 17:11:57 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-VolumesNegativeTest-1281249132 Apr 14 17:11:57 user devstack@n-api.service[61933]: X-User: tempest-VolumesNegativeTest-1281249132-project-member Apr 14 17:11:57 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:11:57 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:11:57 user devstack@n-api.service[61933]: X-User-Id: f659cbd3d9434f979fb51f5b3c4737bb Apr 14 17:11:57 user devstack@n-api.service[61933]: X-User-Name: tempest-VolumesNegativeTest-1281249132-project-member Apr 14 17:11:57 user devstack@n-api.service[61933]: method: Apr 14 17:11:57 user devstack@n-api.service[61933]: exception: Volume 9fa3605c-d103-4777-b9b9-9e3b1546b4ce could not be found. Apr 14 17:11:57 user devstack@n-api.service[61933]: action_args: {'id': '9fa3605c-d103-4777-b9b9-9e3b1546b4ce'} Apr 14 17:11:57 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9fa3605c-d103-4777-b9b9-9e3b1546b4ce could not be found. (HTTP 404) (Request-ID: req-7c5cf979-5045-47ea-9868-84e957816315) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9fa3605c-d103-4777-b9b9-9e3b1546b4ce could not be found. Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9fa3605c-d103-4777-b9b9-9e3b1546b4ce could not be found. Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9fa3605c-d103-4777-b9b9-9e3b1546b4ce could not be found. Apr 14 17:11:57 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:11:57 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-945e9945-fec6-47d4-a1fc-db62459d63ca tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] Returning 404 to user: Volume 9fa3605c-d103-4777-b9b9-9e3b1546b4ce could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:11:57 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-945e9945-fec6-47d4-a1fc-db62459d63ca tempest-VolumesNegativeTest-1281249132 tempest-VolumesNegativeTest-1281249132-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9fa3605c-d103-4777-b9b9-9e3b1546b4ce" status: 404 len: 109 microversion: 2.1 time: 0.042410 Apr 14 17:11:57 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 146/441] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:11:57 2023] GET /compute/v2.1/os-volumes/9fa3605c-d103-4777-b9b9-9e3b1546b4ce => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:11:58 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-8e7c556c-b183-488a-987c-dfff17e2df63 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:11:58 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-8e7c556c-b183-488a-987c-dfff17e2df63 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:11:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8e7c556c-b183-488a-987c-dfff17e2df63 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8e7c556c-b183-488a-987c-dfff17e2df63 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8e7c556c-b183-488a-987c-dfff17e2df63 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8e7c556c-b183-488a-987c-dfff17e2df63 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8e7c556c-b183-488a-987c-dfff17e2df63 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8e7c556c-b183-488a-987c-dfff17e2df63 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:58 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-8e7c556c-b183-488a-987c-dfff17e2df63 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.259105 Apr 14 17:11:58 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 150/442] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 17:11:58 2023] GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac/os-interface => generated 283 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:11:59 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-719206f5-3b0c-4c35-a594-9e52cc0de827 req-50ab3ff5-f89f-4f8f-87ac-f64ac5e3e93b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7213d0b2-6eac-449b-aa4b-44088686abac", "tag": "84d1f2c3-e095-4535-92c3-9ff189992179"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:11:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-719206f5-3b0c-4c35-a594-9e52cc0de827 req-50ab3ff5-f89f-4f8f-87ac-f64ac5e3e93b service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-719206f5-3b0c-4c35-a594-9e52cc0de827 req-50ab3ff5-f89f-4f8f-87ac-f64ac5e3e93b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-719206f5-3b0c-4c35-a594-9e52cc0de827 req-50ab3ff5-f89f-4f8f-87ac-f64ac5e3e93b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:59 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-719206f5-3b0c-4c35-a594-9e52cc0de827 req-50ab3ff5-f89f-4f8f-87ac-f64ac5e3e93b service nova] Creating event network-changed:84d1f2c3-e095-4535-92c3-9ff189992179 for instance 7213d0b2-6eac-449b-aa4b-44088686abac on user Apr 14 17:11:59 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-719206f5-3b0c-4c35-a594-9e52cc0de827 req-50ab3ff5-f89f-4f8f-87ac-f64ac5e3e93b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031619 Apr 14 17:11:59 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 147/443] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:11:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:11:59 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-51a48b1f-3d81-4d32-9606-d117b5224ed1 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:11:59 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-51a48b1f-3d81-4d32-9606-d117b5224ed1 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:11:59 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-51a48b1f-3d81-4d32-9606-d117b5224ed1 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:59 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-51a48b1f-3d81-4d32-9606-d117b5224ed1 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:59 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-51a48b1f-3d81-4d32-9606-d117b5224ed1 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:59 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-51a48b1f-3d81-4d32-9606-d117b5224ed1 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:11:59 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-51a48b1f-3d81-4d32-9606-d117b5224ed1 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:11:59 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-51a48b1f-3d81-4d32-9606-d117b5224ed1 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:11:59 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-51a48b1f-3d81-4d32-9606-d117b5224ed1 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac/ips" status: 200 len: 109 microversion: 2.1 time: 0.048707 Apr 14 17:11:59 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 147/444] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 17:11:59 2023] GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac/ips => generated 109 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:12:00 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-889345f2-12ca-4f0e-8a16-4f489ac8fb3f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:12:00 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-889345f2-12ca-4f0e-8a16-4f489ac8fb3f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-889345f2-12ca-4f0e-8a16-4f489ac8fb3f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-889345f2-12ca-4f0e-8a16-4f489ac8fb3f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-889345f2-12ca-4f0e-8a16-4f489ac8fb3f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-889345f2-12ca-4f0e-8a16-4f489ac8fb3f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-889345f2-12ca-4f0e-8a16-4f489ac8fb3f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-889345f2-12ca-4f0e-8a16-4f489ac8fb3f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:00 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-889345f2-12ca-4f0e-8a16-4f489ac8fb3f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:12:00 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-889345f2-12ca-4f0e-8a16-4f489ac8fb3f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1656 microversion: 2.1 time: 0.228164 Apr 14 17:12:00 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 151/445] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:12:00 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1656 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:12:00 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64feafc1-f567-4496-bde0-d3fa057a7728"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:00 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:01 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-85661878-a1a0-47a3-b29b-0fb1c893f3dc tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "POST /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282517 Apr 14 17:12:01 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 148/446] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:12:00 2023] POST /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 17:12:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-02d0116e-f200-4547-8284-30a238856f24 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:12:01 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-02d0116e-f200-4547-8284-30a238856f24 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-02d0116e-f200-4547-8284-30a238856f24 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-02d0116e-f200-4547-8284-30a238856f24 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-02d0116e-f200-4547-8284-30a238856f24 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-02d0116e-f200-4547-8284-30a238856f24 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-02d0116e-f200-4547-8284-30a238856f24 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-02d0116e-f200-4547-8284-30a238856f24 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8612253-7088-46ce-82ea-01673c071861"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:01 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:02 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-02d0116e-f200-4547-8284-30a238856f24 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c4734925f645248b0f9060aa78a502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8f6b39515e456c9f5a1affa9f79000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:12:02 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-02d0116e-f200-4547-8284-30a238856f24 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97" status: 200 len: 1654 microversion: 2.1 time: 0.276867 Apr 14 17:12:02 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 148/447] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:12:01 2023] GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97 => generated 1654 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:12:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-3a48da45-e254-4bdd-9a9b-4143fd92a991 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324807 Apr 14 17:12:02 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 152/448] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:12:01 2023] POST /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:12:09 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-29619c61-d9f7-4f93-9332-c9bf0e0f3d32 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8612253-7088-46ce-82ea-01673c071861"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:09 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-29619c61-d9f7-4f93-9332-c9bf0e0f3d32 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:09 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=15 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:12:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-29619c61-d9f7-4f93-9332-c9bf0e0f3d32 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-29619c61-d9f7-4f93-9332-c9bf0e0f3d32 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-29619c61-d9f7-4f93-9332-c9bf0e0f3d32 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-29619c61-d9f7-4f93-9332-c9bf0e0f3d32 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-29619c61-d9f7-4f93-9332-c9bf0e0f3d32 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-29619c61-d9f7-4f93-9332-c9bf0e0f3d32 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:09 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-29619c61-d9f7-4f93-9332-c9bf0e0f3d32 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] HTTP exception thrown: Invalid volume: volume d8612253-7088-46ce-82ea-01673c071861 is already attached to instances: 7213d0b2-6eac-449b-aa4b-44088686abac Apr 14 17:12:09 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-29619c61-d9f7-4f93-9332-c9bf0e0f3d32 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Request method failure captured: Apr 14 17:12:09 user devstack@n-api.service[61934]: request: POST /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac/os-volume_attachments HTTP/1.1 Apr 14 17:12:09 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:12:09 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:12:09 user devstack@n-api.service[61934]: Connection: close Apr 14 17:12:09 user devstack@n-api.service[61934]: Content-Length: 74 Apr 14 17:12:09 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:12:09 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:12:09 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:12:09 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:12:09 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYdYtBTMjEs6wq_AX7uLwl48FezTrz7FyW6CSVOm9G6i0ttgahwJf1S74Fss_9qd0JO9t5wr7pQDv25cSrw7tI0XNOdCBZPRJQlF-w0w2Xn2ZRZ5EUArK2xGuE0HglaJJpHNyoLBzYQsp9Av8_ba24psGn8qYzpzCLzlLWiMZvDXQQQ Apr 14 17:12:09 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:12:09 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:12:09 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:12:09 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:12:09 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:12:09 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:12:09 user devstack@n-api.service[61934]: X-Project-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:12:09 user devstack@n-api.service[61934]: X-Project-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:12:09 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:12:09 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:12:09 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6f341a2096b9483787b569a59f325556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:12:09 user devstack@n-api.service[61934]: X-Tenant: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:12:09 user devstack@n-api.service[61934]: X-Tenant-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:12:09 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:12:09 user devstack@n-api.service[61934]: X-User: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:12:09 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:12:09 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:12:09 user devstack@n-api.service[61934]: X-User-Id: d9c9e0d318eb4ca49d47d620682fb00a Apr 14 17:12:09 user devstack@n-api.service[61934]: X-User-Name: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:12:09 user devstack@n-api.service[61934]: Apr 14 17:12:09 user devstack@n-api.service[61934]: {"volumeAttachment": {"volumeId": "d8612253-7088-46ce-82ea-01673c071861"}} Apr 14 17:12:09 user devstack@n-api.service[61934]: method: > Apr 14 17:12:09 user devstack@n-api.service[61934]: exception: Invalid volume: volume d8612253-7088-46ce-82ea-01673c071861 is already attached to instances: 7213d0b2-6eac-449b-aa4b-44088686abac Apr 14 17:12:09 user devstack@n-api.service[61934]: action_args: {'server_id': '7213d0b2-6eac-449b-aa4b-44088686abac', 'body': {'volumeAttachment': {'volumeId': 'd8612253-7088-46ce-82ea-01673c071861'}}} Apr 14 17:12:09 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d8612253-7088-46ce-82ea-01673c071861 is already attached to instances: 7213d0b2-6eac-449b-aa4b-44088686abac Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d8612253-7088-46ce-82ea-01673c071861 is already attached to instances: 7213d0b2-6eac-449b-aa4b-44088686abac Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d8612253-7088-46ce-82ea-01673c071861 is already attached to instances: 7213d0b2-6eac-449b-aa4b-44088686abac Apr 14 17:12:09 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:12:09 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-29619c61-d9f7-4f93-9332-c9bf0e0f3d32 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Returning 400 to user: Invalid volume: volume d8612253-7088-46ce-82ea-01673c071861 is already attached to instances: 7213d0b2-6eac-449b-aa4b-44088686abac {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:12:09 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-29619c61-d9f7-4f93-9332-c9bf0e0f3d32 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100414 Apr 14 17:12:09 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 149/449] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:12:09 2023] POST /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:12:10 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:12:10 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:10 user devstack@n-api.service[61933]: DEBUG nova.objects.instance [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'services' on Instance uuid 7213d0b2-6eac-449b-aa4b-44088686abac {{(pid=61933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:12:10 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-175b4910-1a7f-4f5b-b37c-5ecc411dfe45 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac/os-volume_attachments/d8612253-7088-46ce-82ea-01673c071861" status: 202 len: 0 microversion: 2.1 time: 0.182214 Apr 14 17:12:10 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 149/450] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:12:10 2023] DELETE /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac/os-volume_attachments/d8612253-7088-46ce-82ea-01673c071861 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:12:10 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-e8e8b603-1a24-43de-93ac-1cfba763225b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:12:10 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-e8e8b603-1a24-43de-93ac-1cfba763225b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:10 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:12:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e8e8b603-1a24-43de-93ac-1cfba763225b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e8e8b603-1a24-43de-93ac-1cfba763225b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e8e8b603-1a24-43de-93ac-1cfba763225b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e8e8b603-1a24-43de-93ac-1cfba763225b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e8e8b603-1a24-43de-93ac-1cfba763225b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e8e8b603-1a24-43de-93ac-1cfba763225b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:10 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:12:10 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-e8e8b603-1a24-43de-93ac-1cfba763225b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079830 Apr 14 17:12:10 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 153/451] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:12:10 2023] GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:12:11 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-b6f2a97f-c53c-40b7-bcaf-1b291cbae104 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:12:11 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-b6f2a97f-c53c-40b7-bcaf-1b291cbae104 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b6f2a97f-c53c-40b7-bcaf-1b291cbae104 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b6f2a97f-c53c-40b7-bcaf-1b291cbae104 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b6f2a97f-c53c-40b7-bcaf-1b291cbae104 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b6f2a97f-c53c-40b7-bcaf-1b291cbae104 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b6f2a97f-c53c-40b7-bcaf-1b291cbae104 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b6f2a97f-c53c-40b7-bcaf-1b291cbae104 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:11 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-b6f2a97f-c53c-40b7-bcaf-1b291cbae104 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:12:11 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-b6f2a97f-c53c-40b7-bcaf-1b291cbae104 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1702 microversion: 2.1 time: 0.609937 Apr 14 17:12:11 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 150/452] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:12:11 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1702 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:12:11 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-595094216", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:11 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:11 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting quotas for project 978cd1b4b6434b298731b01dac02591c. Resources: dict_keys(['metadata_items']) {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:12:11 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting quotas for user a22398c18fcc48aca2f0f9691f1c1143 and project 978cd1b4b6434b298731b01dac02591c. Resources: dict_keys(['metadata_items']) {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:12:11 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:12:11 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:12:11 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:12:11 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:12:11 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:12:12 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:12 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-dc183e6e-7d67-4a64-ada1-052763b7d4c2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "POST /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/action" status: 202 len: 1158 microversion: 2.1 time: 0.371812 Apr 14 17:12:12 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 150/453] 10.0.0.210 () {64 vars in 1356 bytes} [Fri Apr 14 17:12:11 2023] POST /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/action => generated 1158 bytes in 374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 17:12:12 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-6009898b-22a0-4a3f-a38f-c96ab4ba050b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:12:12 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-6009898b-22a0-4a3f-a38f-c96ab4ba050b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-6009898b-22a0-4a3f-a38f-c96ab4ba050b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-6009898b-22a0-4a3f-a38f-c96ab4ba050b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-6009898b-22a0-4a3f-a38f-c96ab4ba050b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-6009898b-22a0-4a3f-a38f-c96ab4ba050b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-6009898b-22a0-4a3f-a38f-c96ab4ba050b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-6009898b-22a0-4a3f-a38f-c96ab4ba050b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:12 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-6009898b-22a0-4a3f-a38f-c96ab4ba050b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:12:12 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-6009898b-22a0-4a3f-a38f-c96ab4ba050b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1730 microversion: 2.1 time: 0.160088 Apr 14 17:12:12 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 154/454] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:12:12 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:12:12 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-0e216f53-b089-47b6-bea3-1bc52da772a8 req-65293c27-4887-45a3-9e10-b621bc467c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "name": "network-vif-unplugged", "status": "completed", "tag": "de268504-352a-4d08-8113-a2098b794478"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-0e216f53-b089-47b6-bea3-1bc52da772a8 req-65293c27-4887-45a3-9e10-b621bc467c3a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-0e216f53-b089-47b6-bea3-1bc52da772a8 req-65293c27-4887-45a3-9e10-b621bc467c3a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-0e216f53-b089-47b6-bea3-1bc52da772a8 req-65293c27-4887-45a3-9e10-b621bc467c3a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:12 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-0e216f53-b089-47b6-bea3-1bc52da772a8 req-65293c27-4887-45a3-9e10-b621bc467c3a service nova] Creating event network-vif-unplugged:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:12:12 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-0e216f53-b089-47b6-bea3-1bc52da772a8 req-65293c27-4887-45a3-9e10-b621bc467c3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037406 Apr 14 17:12:12 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 151/455] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:12:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:12:14 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-a2dabe9e-c4e7-4e54-a01b-c76ede59b767 req-ad5646f3-b8b3-401c-8f2d-f735d8b0acc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "name": "network-vif-plugged", "status": "completed", "tag": "de268504-352a-4d08-8113-a2098b794478"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:14 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:12:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-a2dabe9e-c4e7-4e54-a01b-c76ede59b767 req-ad5646f3-b8b3-401c-8f2d-f735d8b0acc7 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-a2dabe9e-c4e7-4e54-a01b-c76ede59b767 req-ad5646f3-b8b3-401c-8f2d-f735d8b0acc7 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-a2dabe9e-c4e7-4e54-a01b-c76ede59b767 req-ad5646f3-b8b3-401c-8f2d-f735d8b0acc7 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:14 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=3,nova_cell1:UPDATE=4,nova_cell1:DELETE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:12:14 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-a2dabe9e-c4e7-4e54-a01b-c76ede59b767 req-ad5646f3-b8b3-401c-8f2d-f735d8b0acc7 service nova] Creating event network-vif-plugged:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:12:14 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-a2dabe9e-c4e7-4e54-a01b-c76ede59b767 req-ad5646f3-b8b3-401c-8f2d-f735d8b0acc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047553 Apr 14 17:12:14 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 151/456] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:12:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:12:16 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-4b6c5def-b097-4d26-8585-0f2a76077a6e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:12:16 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-4b6c5def-b097-4d26-8585-0f2a76077a6e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4b6c5def-b097-4d26-8585-0f2a76077a6e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4b6c5def-b097-4d26-8585-0f2a76077a6e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4b6c5def-b097-4d26-8585-0f2a76077a6e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4b6c5def-b097-4d26-8585-0f2a76077a6e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4b6c5def-b097-4d26-8585-0f2a76077a6e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4b6c5def-b097-4d26-8585-0f2a76077a6e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:16 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-4b6c5def-b097-4d26-8585-0f2a76077a6e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] HTTP exception thrown: Instance 7465a41f-c916-4cca-8084-7c646409007d could not be found. Apr 14 17:12:16 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-4b6c5def-b097-4d26-8585-0f2a76077a6e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Request method failure captured: Apr 14 17:12:16 user devstack@n-api.service[61935]: request: DELETE /compute/v2.1/servers/7465a41f-c916-4cca-8084-7c646409007d HTTP/1.1 Apr 14 17:12:16 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:12:16 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:12:16 user devstack@n-api.service[61935]: Connection: close Apr 14 17:12:16 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:12:16 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:12:16 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:12:16 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:12:16 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:12:16 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYdeer58jEvUR9ADIlb0N430T-Ds21-KcdHVVoui-D_EAL5w5NtUAiByINleZljOdamOoVfvloz9qBpRKJNkBB-q3J2hMItuCYI1rvO5iZ-gzcRL6EYmrivLdXp9j61AUeL3LT7o_QloEQzxw1RchmjWXo1xX65gA6Tz8oI3QnBXw6g Apr 14 17:12:16 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:12:16 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:12:16 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:12:16 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:12:16 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:12:16 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:12:16 user devstack@n-api.service[61935]: X-Project-Id: 426156fb00db428683851cf731b680d1 Apr 14 17:12:16 user devstack@n-api.service[61935]: X-Project-Name: tempest-ServersNegativeTestJSON-1832599821 Apr 14 17:12:16 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:12:16 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:12:16 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426156fb00db428683851cf731b680d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426156fb00db428683851cf731b680d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/426156fb00db428683851cf731b680d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:12:16 user devstack@n-api.service[61935]: X-Tenant: tempest-ServersNegativeTestJSON-1832599821 Apr 14 17:12:16 user devstack@n-api.service[61935]: X-Tenant-Id: 426156fb00db428683851cf731b680d1 Apr 14 17:12:16 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832599821 Apr 14 17:12:16 user devstack@n-api.service[61935]: X-User: tempest-ServersNegativeTestJSON-1832599821-project-member Apr 14 17:12:16 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:12:16 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:12:16 user devstack@n-api.service[61935]: X-User-Id: 0d1ea0218b044c1e94f61a07c1d14a75 Apr 14 17:12:16 user devstack@n-api.service[61935]: X-User-Name: tempest-ServersNegativeTestJSON-1832599821-project-member Apr 14 17:12:16 user devstack@n-api.service[61935]: method: > Apr 14 17:12:16 user devstack@n-api.service[61935]: exception: Instance 7465a41f-c916-4cca-8084-7c646409007d could not be found. Apr 14 17:12:16 user devstack@n-api.service[61935]: action_args: {'id': '7465a41f-c916-4cca-8084-7c646409007d'} Apr 14 17:12:16 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7465a41f-c916-4cca-8084-7c646409007d could not be found. Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7465a41f-c916-4cca-8084-7c646409007d could not be found. Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7465a41f-c916-4cca-8084-7c646409007d could not be found. Apr 14 17:12:16 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:12:16 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-4b6c5def-b097-4d26-8585-0f2a76077a6e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Returning 404 to user: Instance 7465a41f-c916-4cca-8084-7c646409007d could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:12:16 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-4b6c5def-b097-4d26-8585-0f2a76077a6e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7465a41f-c916-4cca-8084-7c646409007d" status: 404 len: 111 microversion: 2.1 time: 0.036290 Apr 14 17:12:16 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 155/457] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:12:16 2023] DELETE /compute/v2.1/servers/7465a41f-c916-4cca-8084-7c646409007d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:12:16 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-d3ec77c4-4998-4a86-80f3-5fcb01124621 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:12:16 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-d3ec77c4-4998-4a86-80f3-5fcb01124621 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 7465a41f-c916-4cca-8084-7c646409007d] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d3ec77c4-4998-4a86-80f3-5fcb01124621 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d3ec77c4-4998-4a86-80f3-5fcb01124621 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d3ec77c4-4998-4a86-80f3-5fcb01124621 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d3ec77c4-4998-4a86-80f3-5fcb01124621 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d3ec77c4-4998-4a86-80f3-5fcb01124621 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d3ec77c4-4998-4a86-80f3-5fcb01124621 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:16 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-d3ec77c4-4998-4a86-80f3-5fcb01124621 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] HTTP exception thrown: Instance 7465a41f-c916-4cca-8084-7c646409007d could not be found. Apr 14 17:12:16 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-d3ec77c4-4998-4a86-80f3-5fcb01124621 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Request method failure captured: Apr 14 17:12:16 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/7465a41f-c916-4cca-8084-7c646409007d HTTP/1.1 Apr 14 17:12:16 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:12:16 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:12:16 user devstack@n-api.service[61934]: Connection: close Apr 14 17:12:16 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:12:16 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:12:16 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:12:16 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:12:16 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:12:16 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYdeer58jEvUR9ADIlb0N430T-Ds21-KcdHVVoui-D_EAL5w5NtUAiByINleZljOdamOoVfvloz9qBpRKJNkBB-q3J2hMItuCYI1rvO5iZ-gzcRL6EYmrivLdXp9j61AUeL3LT7o_QloEQzxw1RchmjWXo1xX65gA6Tz8oI3QnBXw6g Apr 14 17:12:16 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:12:16 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:12:16 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:12:16 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:12:16 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:12:16 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:12:16 user devstack@n-api.service[61934]: X-Project-Id: 426156fb00db428683851cf731b680d1 Apr 14 17:12:16 user devstack@n-api.service[61934]: X-Project-Name: tempest-ServersNegativeTestJSON-1832599821 Apr 14 17:12:16 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:12:16 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:12:16 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426156fb00db428683851cf731b680d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426156fb00db428683851cf731b680d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/426156fb00db428683851cf731b680d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:12:16 user devstack@n-api.service[61934]: X-Tenant: tempest-ServersNegativeTestJSON-1832599821 Apr 14 17:12:16 user devstack@n-api.service[61934]: X-Tenant-Id: 426156fb00db428683851cf731b680d1 Apr 14 17:12:16 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832599821 Apr 14 17:12:16 user devstack@n-api.service[61934]: X-User: tempest-ServersNegativeTestJSON-1832599821-project-member Apr 14 17:12:16 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:12:16 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:12:16 user devstack@n-api.service[61934]: X-User-Id: 0d1ea0218b044c1e94f61a07c1d14a75 Apr 14 17:12:16 user devstack@n-api.service[61934]: X-User-Name: tempest-ServersNegativeTestJSON-1832599821-project-member Apr 14 17:12:16 user devstack@n-api.service[61934]: method: > Apr 14 17:12:16 user devstack@n-api.service[61934]: exception: Instance 7465a41f-c916-4cca-8084-7c646409007d could not be found. Apr 14 17:12:16 user devstack@n-api.service[61934]: action_args: {'id': '7465a41f-c916-4cca-8084-7c646409007d'} Apr 14 17:12:16 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7465a41f-c916-4cca-8084-7c646409007d could not be found. Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7465a41f-c916-4cca-8084-7c646409007d could not be found. Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7465a41f-c916-4cca-8084-7c646409007d could not be found. Apr 14 17:12:16 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:12:16 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-d3ec77c4-4998-4a86-80f3-5fcb01124621 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Returning 404 to user: Instance 7465a41f-c916-4cca-8084-7c646409007d could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:12:16 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-d3ec77c4-4998-4a86-80f3-5fcb01124621 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7465a41f-c916-4cca-8084-7c646409007d" status: 404 len: 111 microversion: 2.1 time: 0.034038 Apr 14 17:12:16 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 152/458] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:12:16 2023] GET /compute/v2.1/servers/7465a41f-c916-4cca-8084-7c646409007d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:12:16 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:12:16 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:16 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Going to try to terminate instance {{(pid=61933) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:12:17 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-bcf98abe-e326-4e8c-827c-59e0e4d1e725 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d" status: 204 len: 0 microversion: 2.1 time: 0.135553 Apr 14 17:12:17 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 152/459] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:12:16 2023] DELETE /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:12:17 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a1735156-6ccd-40cc-ad36-eac45411e16e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:12:17 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-a1735156-6ccd-40cc-ad36-eac45411e16e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a1735156-6ccd-40cc-ad36-eac45411e16e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a1735156-6ccd-40cc-ad36-eac45411e16e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a1735156-6ccd-40cc-ad36-eac45411e16e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a1735156-6ccd-40cc-ad36-eac45411e16e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a1735156-6ccd-40cc-ad36-eac45411e16e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a1735156-6ccd-40cc-ad36-eac45411e16e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:17 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-a1735156-6ccd-40cc-ad36-eac45411e16e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1ea0218b044c1e94f61a07c1d14a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426156fb00db428683851cf731b680d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:12:17 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-a1735156-6ccd-40cc-ad36-eac45411e16e tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d" status: 200 len: 1498 microversion: 2.1 time: 0.340852 Apr 14 17:12:17 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 156/460] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:12:17 2023] GET /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d => generated 1498 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:12:17 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-93865952-9a2d-4b0e-8204-9b73124886f6 req-8360fb0f-52fe-417a-b0b1-38e356fae630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed9bc80-9e7d-4de9-ac86-704c927b111d", "name": "network-vif-unplugged", "status": "completed", "tag": "0b4fc330-8a13-4916-b3be-16398b46bec1"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:17 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-93865952-9a2d-4b0e-8204-9b73124886f6 req-8360fb0f-52fe-417a-b0b1-38e356fae630 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:17 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-93865952-9a2d-4b0e-8204-9b73124886f6 req-8360fb0f-52fe-417a-b0b1-38e356fae630 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:17 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-93865952-9a2d-4b0e-8204-9b73124886f6 req-8360fb0f-52fe-417a-b0b1-38e356fae630 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:17 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-93865952-9a2d-4b0e-8204-9b73124886f6 req-8360fb0f-52fe-417a-b0b1-38e356fae630 service nova] Creating event network-vif-unplugged:0b4fc330-8a13-4916-b3be-16398b46bec1 for instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d on user Apr 14 17:12:17 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-93865952-9a2d-4b0e-8204-9b73124886f6 req-8360fb0f-52fe-417a-b0b1-38e356fae630 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032682 Apr 14 17:12:17 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 153/461] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:12:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:12:19 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed9bc80-9e7d-4de9-ac86-704c927b111d", "name": "network-vif-plugged", "status": "completed", "tag": "0b4fc330-8a13-4916-b3be-16398b46bec1"}, {"server_uuid": "3ed9bc80-9e7d-4de9-ac86-704c927b111d", "name": "network-vif-plugged", "status": "completed", "tag": "0b4fc330-8a13-4916-b3be-16398b46bec1"}, {"server_uuid": "3ed9bc80-9e7d-4de9-ac86-704c927b111d", "name": "network-vif-plugged", "status": "completed", "tag": "0b4fc330-8a13-4916-b3be-16398b46bec1"}, {"server_uuid": "3ed9bc80-9e7d-4de9-ac86-704c927b111d", "name": "network-vif-plugged", "status": "completed", "tag": "0b4fc330-8a13-4916-b3be-16398b46bec1"}, {"server_uuid": "3ed9bc80-9e7d-4de9-ac86-704c927b111d", "name": "network-vif-deleted", "tag": "0b4fc330-8a13-4916-b3be-16398b46bec1"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Creating event network-vif-plugged:0b4fc330-8a13-4916-b3be-16398b46bec1 for instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d on user Apr 14 17:12:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Creating event network-vif-plugged:0b4fc330-8a13-4916-b3be-16398b46bec1 for instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d on user Apr 14 17:12:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Creating event network-vif-plugged:0b4fc330-8a13-4916-b3be-16398b46bec1 for instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d on user Apr 14 17:12:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Creating event network-vif-plugged:0b4fc330-8a13-4916-b3be-16398b46bec1 for instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d on user Apr 14 17:12:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] Creating event network-vif-deleted:0b4fc330-8a13-4916-b3be-16398b46bec1 for instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d on user Apr 14 17:12:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-7fa1c1d6-9415-43ab-8152-a295e6073f77 req-b975b587-bda2-44de-8612-2a1e8206d48a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.035903 Apr 14 17:12:19 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 153/462] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:12:19 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:12:22 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-0cec177d-99fb-46f1-b426-76bc1dcae568 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37d0e1b4-870e-494c-bc85-ee2c56c4c81f"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:22 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-0cec177d-99fb-46f1-b426-76bc1dcae568 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0cec177d-99fb-46f1-b426-76bc1dcae568 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0cec177d-99fb-46f1-b426-76bc1dcae568 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0cec177d-99fb-46f1-b426-76bc1dcae568 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0cec177d-99fb-46f1-b426-76bc1dcae568 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0cec177d-99fb-46f1-b426-76bc1dcae568 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0cec177d-99fb-46f1-b426-76bc1dcae568 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:22 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-0cec177d-99fb-46f1-b426-76bc1dcae568 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.323320 Apr 14 17:12:22 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 157/463] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 17:12:22 2023] POST /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/os-volume_attachments => generated 188 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 17:12:22 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:22 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:22 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61934) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 17:12:22 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-44db1549-3a14-4ab4-aafe-61ab2aa53809 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/action" status: 202 len: 0 microversion: 2.20 time: 0.136870 Apr 14 17:12:22 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 154/464] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 17:12:22 2023] POST /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:12:22 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-da70e6fa-347a-4bd4-b8a6-c28e31e0725f tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:12:22 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-da70e6fa-347a-4bd4-b8a6-c28e31e0725f tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-da70e6fa-347a-4bd4-b8a6-c28e31e0725f tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-da70e6fa-347a-4bd4-b8a6-c28e31e0725f tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-da70e6fa-347a-4bd4-b8a6-c28e31e0725f tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-da70e6fa-347a-4bd4-b8a6-c28e31e0725f tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-da70e6fa-347a-4bd4-b8a6-c28e31e0725f tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-da70e6fa-347a-4bd4-b8a6-c28e31e0725f tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:23 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-da70e6fa-347a-4bd4-b8a6-c28e31e0725f tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:12:23 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-da70e6fa-347a-4bd4-b8a6-c28e31e0725f tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:12:23 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-da70e6fa-347a-4bd4-b8a6-c28e31e0725f tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:12:23 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-da70e6fa-347a-4bd4-b8a6-c28e31e0725f tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" status: 200 len: 1738 microversion: 2.20 time: 0.255303 Apr 14 17:12:23 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 154/465] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:12:22 2023] GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:12:23 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-c3971585-26e7-4e4e-b355-424d1ec4199b req-2cd1f1de-54ea-441f-b68f-bfa37f6d9b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "name": "network-vif-plugged", "status": "completed", "tag": "de268504-352a-4d08-8113-a2098b794478"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c3971585-26e7-4e4e-b355-424d1ec4199b req-2cd1f1de-54ea-441f-b68f-bfa37f6d9b93 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c3971585-26e7-4e4e-b355-424d1ec4199b req-2cd1f1de-54ea-441f-b68f-bfa37f6d9b93 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c3971585-26e7-4e4e-b355-424d1ec4199b req-2cd1f1de-54ea-441f-b68f-bfa37f6d9b93 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:23 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c3971585-26e7-4e4e-b355-424d1ec4199b req-2cd1f1de-54ea-441f-b68f-bfa37f6d9b93 service nova] Creating event network-vif-plugged:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:12:23 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-c3971585-26e7-4e4e-b355-424d1ec4199b req-2cd1f1de-54ea-441f-b68f-bfa37f6d9b93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031161 Apr 14 17:12:23 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 158/466] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:12:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:12:25 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-440574f6-e858-48ef-8beb-334dc0417817 req-43292e60-bf9b-4cc7-a536-93bc92952d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "name": "network-vif-plugged", "status": "completed", "tag": "de268504-352a-4d08-8113-a2098b794478"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-440574f6-e858-48ef-8beb-334dc0417817 req-43292e60-bf9b-4cc7-a536-93bc92952d6e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-440574f6-e858-48ef-8beb-334dc0417817 req-43292e60-bf9b-4cc7-a536-93bc92952d6e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-440574f6-e858-48ef-8beb-334dc0417817 req-43292e60-bf9b-4cc7-a536-93bc92952d6e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:25 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-440574f6-e858-48ef-8beb-334dc0417817 req-43292e60-bf9b-4cc7-a536-93bc92952d6e service nova] Creating event network-vif-plugged:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:12:25 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-440574f6-e858-48ef-8beb-334dc0417817 req-43292e60-bf9b-4cc7-a536-93bc92952d6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042928 Apr 14 17:12:25 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 155/467] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:12:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:12:30 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-31dd2c53-2b58-4c20-8473-1e3014d374c0 req-86007124-dc66-45db-a210-948aae7998ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c", "tag": "f606ba05-7c5e-4e88-94ed-a44a82cb8150"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:30 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-31dd2c53-2b58-4c20-8473-1e3014d374c0 req-86007124-dc66-45db-a210-948aae7998ce service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:30 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-31dd2c53-2b58-4c20-8473-1e3014d374c0 req-86007124-dc66-45db-a210-948aae7998ce service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:30 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-31dd2c53-2b58-4c20-8473-1e3014d374c0 req-86007124-dc66-45db-a210-948aae7998ce service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:30 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-31dd2c53-2b58-4c20-8473-1e3014d374c0 req-86007124-dc66-45db-a210-948aae7998ce service nova] Creating event network-changed:f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c on user Apr 14 17:12:30 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-31dd2c53-2b58-4c20-8473-1e3014d374c0 req-86007124-dc66-45db-a210-948aae7998ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040592 Apr 14 17:12:30 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 155/468] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:12:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:12:35 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=11 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:12:35 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:12:35 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-50065a70-db9a-41da-a20a-de5699a71e0e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:12:35 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-50065a70-db9a-41da-a20a-de5699a71e0e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:35 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-50065a70-db9a-41da-a20a-de5699a71e0e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:35 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-50065a70-db9a-41da-a20a-de5699a71e0e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:35 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-50065a70-db9a-41da-a20a-de5699a71e0e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:35 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-50065a70-db9a-41da-a20a-de5699a71e0e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:35 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-50065a70-db9a-41da-a20a-de5699a71e0e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:35 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-50065a70-db9a-41da-a20a-de5699a71e0e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:35 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-50065a70-db9a-41da-a20a-de5699a71e0e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:12:35 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-50065a70-db9a-41da-a20a-de5699a71e0e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5" status: 200 len: 1535 microversion: 2.1 time: 0.297396 Apr 14 17:12:35 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 159/469] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:12:35 2023] GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5 => generated 1535 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:12:38 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:12:38 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:12:38 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:38 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:38 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-b6321d20-4525-4393-8790-f69b5b3fb7cf req-d3da9abd-995e-44e2-a9b8-a0f56a815a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c", "name": "network-vif-plugged", "status": "completed", "tag": "f606ba05-7c5e-4e88-94ed-a44a82cb8150"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:38 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-b6321d20-4525-4393-8790-f69b5b3fb7cf req-d3da9abd-995e-44e2-a9b8-a0f56a815a23 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:38 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-b6321d20-4525-4393-8790-f69b5b3fb7cf req-d3da9abd-995e-44e2-a9b8-a0f56a815a23 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:38 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-b6321d20-4525-4393-8790-f69b5b3fb7cf req-d3da9abd-995e-44e2-a9b8-a0f56a815a23 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:38 user devstack@n-api.service[61934]: DEBUG nova.objects.instance [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'flavor' on Instance uuid 5c01d750-5923-4b61-9f3a-17cf1142f0a5 {{(pid=61934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:12:38 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-b6321d20-4525-4393-8790-f69b5b3fb7cf req-d3da9abd-995e-44e2-a9b8-a0f56a815a23 service nova] Creating event network-vif-plugged:f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c on user Apr 14 17:12:38 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-b6321d20-4525-4393-8790-f69b5b3fb7cf req-d3da9abd-995e-44e2-a9b8-a0f56a815a23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073359 Apr 14 17:12:38 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 156/470] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:12:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:12:38 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-10aeb987-485d-42ed-a6ff-67019c7148d0 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5c01d750-5923-4b61-9f3a-17cf1142f0a5/action" status: 200 len: 32 microversion: 2.1 time: 0.223737 Apr 14 17:12:38 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 156/471] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:12:38 2023] POST /compute/v2.1/servers/5c01d750-5923-4b61-9f3a-17cf1142f0a5/action => generated 32 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:12:38 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-c87bb022-3db3-4baa-9213-78102012ec30 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:12:38 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-c87bb022-3db3-4baa-9213-78102012ec30 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c87bb022-3db3-4baa-9213-78102012ec30 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c87bb022-3db3-4baa-9213-78102012ec30 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c87bb022-3db3-4baa-9213-78102012ec30 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c87bb022-3db3-4baa-9213-78102012ec30 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c87bb022-3db3-4baa-9213-78102012ec30 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c87bb022-3db3-4baa-9213-78102012ec30 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:38 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-c87bb022-3db3-4baa-9213-78102012ec30 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:12:38 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-c87bb022-3db3-4baa-9213-78102012ec30 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c01d750-5923-4b61-9f3a-17cf1142f0a5" status: 200 len: 1509 microversion: 2.1 time: 0.453795 Apr 14 17:12:38 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 160/472] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:12:38 2023] GET /compute/v2.1/servers/5c01d750-5923-4b61-9f3a-17cf1142f0a5 => generated 1509 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:12:39 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "0ea3bcc0-6c41-4430-a140-49dd5b9a58cf"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:39 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:39 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-9093b056-294b-4870-80f3-0dce0c5d0418 req-c8e5a93e-e1c9-43c5-932c-0bc7920836bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c01d750-5923-4b61-9f3a-17cf1142f0a5", "name": "network-vif-unplugged", "status": "completed", "tag": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:39 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-9093b056-294b-4870-80f3-0dce0c5d0418 req-c8e5a93e-e1c9-43c5-932c-0bc7920836bb service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:39 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-9093b056-294b-4870-80f3-0dce0c5d0418 req-c8e5a93e-e1c9-43c5-932c-0bc7920836bb service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:39 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-9093b056-294b-4870-80f3-0dce0c5d0418 req-c8e5a93e-e1c9-43c5-932c-0bc7920836bb service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:39 user devstack@n-api.service[61933]: DEBUG nova.objects.instance [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'flavor' on Instance uuid 1d1a580c-99da-46df-b02d-e2462d8ef26b {{(pid=61933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:12:39 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-9093b056-294b-4870-80f3-0dce0c5d0418 req-c8e5a93e-e1c9-43c5-932c-0bc7920836bb service nova] Creating event network-vif-unplugged:1d44e719-ffdb-40ff-8b17-bf5d79e1df7e for instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 on user Apr 14 17:12:39 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-9093b056-294b-4870-80f3-0dce0c5d0418 req-c8e5a93e-e1c9-43c5-932c-0bc7920836bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036139 Apr 14 17:12:39 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 157/473] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:12:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:12:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d3885092-cc8f-41a8-b2b2-35c26d269850 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b/action" status: 200 len: 29 microversion: 2.87 time: 0.561225 Apr 14 17:12:39 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 157/474] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 17:12:39 2023] POST /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b/action => generated 29 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:12:39 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-8fd9dfc6-4762-49d6-b427-e0b3ba113c11 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:12:39 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-8fd9dfc6-4762-49d6-b427-e0b3ba113c11 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:12:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8fd9dfc6-4762-49d6-b427-e0b3ba113c11 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8fd9dfc6-4762-49d6-b427-e0b3ba113c11 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8fd9dfc6-4762-49d6-b427-e0b3ba113c11 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8fd9dfc6-4762-49d6-b427-e0b3ba113c11 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8fd9dfc6-4762-49d6-b427-e0b3ba113c11 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8fd9dfc6-4762-49d6-b427-e0b3ba113c11 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:40 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-e7e0a121-66fb-4b18-9775-848defff9f5d req-73fc02e3-918c-4b13-abdd-cd38f06e50c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c", "name": "network-vif-plugged", "status": "completed", "tag": "f606ba05-7c5e-4e88-94ed-a44a82cb8150"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:40 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-e7e0a121-66fb-4b18-9775-848defff9f5d req-73fc02e3-918c-4b13-abdd-cd38f06e50c5 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:40 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-e7e0a121-66fb-4b18-9775-848defff9f5d req-73fc02e3-918c-4b13-abdd-cd38f06e50c5 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:40 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-e7e0a121-66fb-4b18-9775-848defff9f5d req-73fc02e3-918c-4b13-abdd-cd38f06e50c5 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:40 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-e7e0a121-66fb-4b18-9775-848defff9f5d req-73fc02e3-918c-4b13-abdd-cd38f06e50c5 service nova] Creating event network-vif-plugged:f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c on user Apr 14 17:12:40 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-e7e0a121-66fb-4b18-9775-848defff9f5d req-73fc02e3-918c-4b13-abdd-cd38f06e50c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055753 Apr 14 17:12:40 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 158/475] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:12:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:12:40 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-8fd9dfc6-4762-49d6-b427-e0b3ba113c11 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:12:40 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-8fd9dfc6-4762-49d6-b427-e0b3ba113c11 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:12:40 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-8fd9dfc6-4762-49d6-b427-e0b3ba113c11 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:12:40 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-8fd9dfc6-4762-49d6-b427-e0b3ba113c11 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b" status: 200 len: 1774 microversion: 2.87 time: 0.730462 Apr 14 17:12:40 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 161/476] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:12:39 2023] GET /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b => generated 1774 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:12:41 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c01d750-5923-4b61-9f3a-17cf1142f0a5", "name": "network-vif-plugged", "status": "completed", "tag": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e"}, {"server_uuid": "1d1a580c-99da-46df-b02d-e2462d8ef26b", "name": "network-vif-unplugged", "status": "completed", "tag": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:41 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:41 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:41 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:41 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] Creating event network-vif-plugged:1d44e719-ffdb-40ff-8b17-bf5d79e1df7e for instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 on user Apr 14 17:12:41 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] Creating event network-vif-unplugged:cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b on user Apr 14 17:12:41 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-790e2ced-2d82-4a3d-bafb-96eac4f6229b req-15db5101-fba9-4685-aad3-bd4e1ec211b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.035766 Apr 14 17:12:41 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 158/477] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:12:41 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:12:43 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1a580c-99da-46df-b02d-e2462d8ef26b", "name": "network-vif-plugged", "status": "completed", "tag": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d"}, {"server_uuid": "5c01d750-5923-4b61-9f3a-17cf1142f0a5", "name": "network-vif-plugged", "status": "completed", "tag": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e"}, {"server_uuid": "5c01d750-5923-4b61-9f3a-17cf1142f0a5", "name": "network-vif-plugged", "status": "completed", "tag": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e"}, {"server_uuid": "1d1a580c-99da-46df-b02d-e2462d8ef26b", "name": "network-vif-plugged", "status": "completed", "tag": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d"}, {"server_uuid": "1d1a580c-99da-46df-b02d-e2462d8ef26b", "name": "network-vif-plugged", "status": "completed", "tag": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d"}, {"server_uuid": "1d1a580c-99da-46df-b02d-e2462d8ef26b", "name": "network-vif-unplugged", "status": "completed", "tag": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d"}, {"server_uuid": "1d1a580c-99da-46df-b02d-e2462d8ef26b", "name": "network-vif-plugged", "status": "completed", "tag": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:43 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:43 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:43 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:43 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Creating event network-vif-plugged:cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b on user Apr 14 17:12:43 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Creating event network-vif-plugged:1d44e719-ffdb-40ff-8b17-bf5d79e1df7e for instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 on user Apr 14 17:12:43 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Creating event network-vif-plugged:1d44e719-ffdb-40ff-8b17-bf5d79e1df7e for instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 on user Apr 14 17:12:43 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Creating event network-vif-plugged:cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b on user Apr 14 17:12:43 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Creating event network-vif-plugged:cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b on user Apr 14 17:12:43 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Creating event network-vif-unplugged:cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b on user Apr 14 17:12:43 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] Creating event network-vif-plugged:cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b on user Apr 14 17:12:43 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-1e8683d3-c54c-41eb-94b8-f3a42bd828e9 req-1e346a83-5d54-497b-8c0d-cdfcf2ee4416 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1211 microversion: 2.1 time: 0.079999 Apr 14 17:12:43 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 159/478] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 17:12:43 2023] POST /compute/v2.1/os-server-external-events => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:12:45 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-984b90cc-e1c8-4f9a-9823-e466c08f6fce req-f75983c9-8745-4166-a5f4-1034ffc5c9fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1a580c-99da-46df-b02d-e2462d8ef26b", "name": "network-vif-plugged", "status": "completed", "tag": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-984b90cc-e1c8-4f9a-9823-e466c08f6fce req-f75983c9-8745-4166-a5f4-1034ffc5c9fe service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-984b90cc-e1c8-4f9a-9823-e466c08f6fce req-f75983c9-8745-4166-a5f4-1034ffc5c9fe service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-984b90cc-e1c8-4f9a-9823-e466c08f6fce req-f75983c9-8745-4166-a5f4-1034ffc5c9fe service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:45 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-984b90cc-e1c8-4f9a-9823-e466c08f6fce req-f75983c9-8745-4166-a5f4-1034ffc5c9fe service nova] Creating event network-vif-plugged:cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b on user Apr 14 17:12:45 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-984b90cc-e1c8-4f9a-9823-e466c08f6fce req-f75983c9-8745-4166-a5f4-1034ffc5c9fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052962 Apr 14 17:12:45 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 162/479] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:12:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:12:47 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-07912802-2b55-47df-b4f1-40e46bc2a5b6 req-fe58f05b-332c-45e5-8033-f68f3aa309d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1a580c-99da-46df-b02d-e2462d8ef26b", "name": "network-vif-plugged", "status": "completed", "tag": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:12:47 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:12:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-07912802-2b55-47df-b4f1-40e46bc2a5b6 req-fe58f05b-332c-45e5-8033-f68f3aa309d7 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:12:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-07912802-2b55-47df-b4f1-40e46bc2a5b6 req-fe58f05b-332c-45e5-8033-f68f3aa309d7 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:12:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-07912802-2b55-47df-b4f1-40e46bc2a5b6 req-fe58f05b-332c-45e5-8033-f68f3aa309d7 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:12:47 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:12:47 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-07912802-2b55-47df-b4f1-40e46bc2a5b6 req-fe58f05b-332c-45e5-8033-f68f3aa309d7 service nova] Creating event network-vif-plugged:cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b on user Apr 14 17:12:47 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-07912802-2b55-47df-b4f1-40e46bc2a5b6 req-fe58f05b-332c-45e5-8033-f68f3aa309d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034805 Apr 14 17:12:47 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 159/480] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:12:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:13:00 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=8 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:13:00 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:13:00 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-cb45f3e8-694d-4317-9c70-46a775630400 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:00 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-cb45f3e8-694d-4317-9c70-46a775630400 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-cb45f3e8-694d-4317-9c70-46a775630400 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-cb45f3e8-694d-4317-9c70-46a775630400 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-cb45f3e8-694d-4317-9c70-46a775630400 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-cb45f3e8-694d-4317-9c70-46a775630400 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-cb45f3e8-694d-4317-9c70-46a775630400 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-cb45f3e8-694d-4317-9c70-46a775630400 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:00 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-cb45f3e8-694d-4317-9c70-46a775630400 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053977 Apr 14 17:13:00 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 160/481] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:13:00 2023] GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:13:00 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=10 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:13:00 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=20 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:13:00 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:00 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:00 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:00 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Going to try to terminate instance {{(pid=61935) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:13:00 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-2e10e6f6-c6ce-41ac-9a20-539bb4818b29 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac" status: 204 len: 0 microversion: 2.1 time: 0.135569 Apr 14 17:13:00 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 163/482] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:13:00 2023] DELETE /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:13:00 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:13:00 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-c324eb0a-49cb-4c1c-a6d5-5a3c9d14c131 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:00 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-c324eb0a-49cb-4c1c-a6d5-5a3c9d14c131 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c324eb0a-49cb-4c1c-a6d5-5a3c9d14c131 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c324eb0a-49cb-4c1c-a6d5-5a3c9d14c131 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c324eb0a-49cb-4c1c-a6d5-5a3c9d14c131 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c324eb0a-49cb-4c1c-a6d5-5a3c9d14c131 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c324eb0a-49cb-4c1c-a6d5-5a3c9d14c131 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c324eb0a-49cb-4c1c-a6d5-5a3c9d14c131 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:00 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-2da8aab6-ce60-439b-8375-b47333875778 req-4ae21237-4b18-4233-9865-d3ba01c014f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7213d0b2-6eac-449b-aa4b-44088686abac", "name": "network-vif-unplugged", "status": "completed", "tag": "84d1f2c3-e095-4535-92c3-9ff189992179"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-2da8aab6-ce60-439b-8375-b47333875778 req-4ae21237-4b18-4233-9865-d3ba01c014f8 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-2da8aab6-ce60-439b-8375-b47333875778 req-4ae21237-4b18-4233-9865-d3ba01c014f8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-2da8aab6-ce60-439b-8375-b47333875778 req-4ae21237-4b18-4233-9865-d3ba01c014f8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:00 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-2da8aab6-ce60-439b-8375-b47333875778 req-4ae21237-4b18-4233-9865-d3ba01c014f8 service nova] Creating event network-vif-unplugged:84d1f2c3-e095-4535-92c3-9ff189992179 for instance 7213d0b2-6eac-449b-aa4b-44088686abac on user Apr 14 17:13:00 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-2da8aab6-ce60-439b-8375-b47333875778 req-4ae21237-4b18-4233-9865-d3ba01c014f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033299 Apr 14 17:13:00 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 161/483] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:13:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:13:00 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-c324eb0a-49cb-4c1c-a6d5-5a3c9d14c131 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c9e0d318eb4ca49d47d620682fb00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f341a2096b9483787b569a59f325556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:13:00 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-c324eb0a-49cb-4c1c-a6d5-5a3c9d14c131 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac" status: 200 len: 1670 microversion: 2.1 time: 0.302372 Apr 14 17:13:00 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 160/484] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:13:00 2023] GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac => generated 1670 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-2eb56740-fb40-447c-b268-0b9bfb03d642 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-2eb56740-fb40-447c-b268-0b9bfb03d642 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:02 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-f7e4fd84-2d87-4f19-a66d-898aa99a70ce tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:02 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-f7e4fd84-2d87-4f19-a66d-898aa99a70ce tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2eb56740-fb40-447c-b268-0b9bfb03d642 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2eb56740-fb40-447c-b268-0b9bfb03d642 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2eb56740-fb40-447c-b268-0b9bfb03d642 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2eb56740-fb40-447c-b268-0b9bfb03d642 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2eb56740-fb40-447c-b268-0b9bfb03d642 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2eb56740-fb40-447c-b268-0b9bfb03d642 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f7e4fd84-2d87-4f19-a66d-898aa99a70ce tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f7e4fd84-2d87-4f19-a66d-898aa99a70ce tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f7e4fd84-2d87-4f19-a66d-898aa99a70ce tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f7e4fd84-2d87-4f19-a66d-898aa99a70ce tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f7e4fd84-2d87-4f19-a66d-898aa99a70ce tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f7e4fd84-2d87-4f19-a66d-898aa99a70ce tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-2eb56740-fb40-447c-b268-0b9bfb03d642 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060345 Apr 14 17:13:02 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 164/485] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:13:02 2023] GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:13:02 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-c10d94a4-bd0d-4798-b456-0a81def0cb48 req-8256954f-8295-431e-8cd3-40a79f055f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7213d0b2-6eac-449b-aa4b-44088686abac", "name": "network-vif-deleted", "tag": "84d1f2c3-e095-4535-92c3-9ff189992179"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c10d94a4-bd0d-4798-b456-0a81def0cb48 req-8256954f-8295-431e-8cd3-40a79f055f92 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c10d94a4-bd0d-4798-b456-0a81def0cb48 req-8256954f-8295-431e-8cd3-40a79f055f92 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c10d94a4-bd0d-4798-b456-0a81def0cb48 req-8256954f-8295-431e-8cd3-40a79f055f92 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:02 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-c10d94a4-bd0d-4798-b456-0a81def0cb48 req-8256954f-8295-431e-8cd3-40a79f055f92 service nova] Creating event network-vif-deleted:84d1f2c3-e095-4535-92c3-9ff189992179 for instance 7213d0b2-6eac-449b-aa4b-44088686abac on user Apr 14 17:13:02 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-c10d94a4-bd0d-4798-b456-0a81def0cb48 req-8256954f-8295-431e-8cd3-40a79f055f92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032944 Apr 14 17:13:02 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 161/486] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:13:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Going to try to terminate instance {{(pid=61935) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:13:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-caa242a9-4c56-4a71-96c9-2d2e4727a428 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97" status: 204 len: 0 microversion: 2.1 time: 0.129106 Apr 14 17:13:02 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 165/487] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:13:02 2023] DELETE /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:13:02 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-753ae450-675a-4f03-b3f4-bc2791b1f290 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:02 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-f7e4fd84-2d87-4f19-a66d-898aa99a70ce tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:13:02 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-753ae450-675a-4f03-b3f4-bc2791b1f290 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:02 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-f7e4fd84-2d87-4f19-a66d-898aa99a70ce tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1721 microversion: 2.1 time: 0.278824 Apr 14 17:13:02 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 162/488] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:13:02 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1721 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:13:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-753ae450-675a-4f03-b3f4-bc2791b1f290 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-753ae450-675a-4f03-b3f4-bc2791b1f290 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-753ae450-675a-4f03-b3f4-bc2791b1f290 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-753ae450-675a-4f03-b3f4-bc2791b1f290 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-753ae450-675a-4f03-b3f4-bc2791b1f290 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-753ae450-675a-4f03-b3f4-bc2791b1f290 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-aec69218-da6e-4a4e-b804-3e8a706ec0b8 req-ba89b320-39b5-43cf-ac82-d47d8edb811b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7213d0b2-6eac-449b-aa4b-44088686abac", "name": "network-vif-plugged", "status": "completed", "tag": "84d1f2c3-e095-4535-92c3-9ff189992179"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-aec69218-da6e-4a4e-b804-3e8a706ec0b8 req-ba89b320-39b5-43cf-ac82-d47d8edb811b service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-aec69218-da6e-4a4e-b804-3e8a706ec0b8 req-ba89b320-39b5-43cf-ac82-d47d8edb811b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-aec69218-da6e-4a4e-b804-3e8a706ec0b8 req-ba89b320-39b5-43cf-ac82-d47d8edb811b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-aec69218-da6e-4a4e-b804-3e8a706ec0b8 req-ba89b320-39b5-43cf-ac82-d47d8edb811b service nova] Creating event network-vif-plugged:84d1f2c3-e095-4535-92c3-9ff189992179 for instance 7213d0b2-6eac-449b-aa4b-44088686abac on user Apr 14 17:13:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-aec69218-da6e-4a4e-b804-3e8a706ec0b8 req-ba89b320-39b5-43cf-ac82-d47d8edb811b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033842 Apr 14 17:13:02 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 166/489] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:13:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:13:02 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-6e7caee6-402f-4fa0-b848-337b88e49a3f req-9b0e621b-d588-4ef1-8b42-52b1a142873e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "name": "network-vif-unplugged", "status": "completed", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-6e7caee6-402f-4fa0-b848-337b88e49a3f req-9b0e621b-d588-4ef1-8b42-52b1a142873e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-6e7caee6-402f-4fa0-b848-337b88e49a3f req-9b0e621b-d588-4ef1-8b42-52b1a142873e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-6e7caee6-402f-4fa0-b848-337b88e49a3f req-9b0e621b-d588-4ef1-8b42-52b1a142873e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:02 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-6e7caee6-402f-4fa0-b848-337b88e49a3f req-9b0e621b-d588-4ef1-8b42-52b1a142873e service nova] Creating event network-vif-unplugged:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:13:02 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-6e7caee6-402f-4fa0-b848-337b88e49a3f req-9b0e621b-d588-4ef1-8b42-52b1a142873e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027881 Apr 14 17:13:02 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 163/490] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:13:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:13:03 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-753ae450-675a-4f03-b3f4-bc2791b1f290 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c4734925f645248b0f9060aa78a502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8f6b39515e456c9f5a1affa9f79000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:13:03 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-753ae450-675a-4f03-b3f4-bc2791b1f290 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97" status: 200 len: 1660 microversion: 2.1 time: 0.528483 Apr 14 17:13:03 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 162/491] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:13:02 2023] GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97 => generated 1660 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:13:04 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-dfb8fd3a-1594-465c-9e0a-7731cee04ff8 req-6195fc02-0b70-4b98-9a72-7a6bdfa91f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "name": "network-vif-deleted", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-dfb8fd3a-1594-465c-9e0a-7731cee04ff8 req-6195fc02-0b70-4b98-9a72-7a6bdfa91f6e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-dfb8fd3a-1594-465c-9e0a-7731cee04ff8 req-6195fc02-0b70-4b98-9a72-7a6bdfa91f6e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-dfb8fd3a-1594-465c-9e0a-7731cee04ff8 req-6195fc02-0b70-4b98-9a72-7a6bdfa91f6e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:04 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-dfb8fd3a-1594-465c-9e0a-7731cee04ff8 req-6195fc02-0b70-4b98-9a72-7a6bdfa91f6e service nova] Creating event network-vif-deleted:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:13:04 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-dfb8fd3a-1594-465c-9e0a-7731cee04ff8 req-6195fc02-0b70-4b98-9a72-7a6bdfa91f6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038491 Apr 14 17:13:04 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 167/492] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:13:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:13:05 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-0178cb96-0e2b-44bc-9d56-e22a61be1bee req-2b0559a7-fa90-4f54-98ce-3264b2fe8e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68b702a-a0dc-4030-9893-87b4ef44fb97", "name": "network-vif-plugged", "status": "completed", "tag": "6ed5f4a5-3c4e-48f6-8667-efda89e23575"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-0178cb96-0e2b-44bc-9d56-e22a61be1bee req-2b0559a7-fa90-4f54-98ce-3264b2fe8e2a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-0178cb96-0e2b-44bc-9d56-e22a61be1bee req-2b0559a7-fa90-4f54-98ce-3264b2fe8e2a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-0178cb96-0e2b-44bc-9d56-e22a61be1bee req-2b0559a7-fa90-4f54-98ce-3264b2fe8e2a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:05 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-0178cb96-0e2b-44bc-9d56-e22a61be1bee req-2b0559a7-fa90-4f54-98ce-3264b2fe8e2a service nova] Creating event network-vif-plugged:6ed5f4a5-3c4e-48f6-8667-efda89e23575 for instance d68b702a-a0dc-4030-9893-87b4ef44fb97 on user Apr 14 17:13:05 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-0178cb96-0e2b-44bc-9d56-e22a61be1bee req-2b0559a7-fa90-4f54-98ce-3264b2fe8e2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030628 Apr 14 17:13:05 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 164/493] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:13:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:13:07 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-7db4ad83-c0e9-4e67-88de-f6fef8984494 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:07 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-7db4ad83-c0e9-4e67-88de-f6fef8984494 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] [instance: 3ed9bc80-9e7d-4de9-ac86-704c927b111d] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7db4ad83-c0e9-4e67-88de-f6fef8984494 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7db4ad83-c0e9-4e67-88de-f6fef8984494 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7db4ad83-c0e9-4e67-88de-f6fef8984494 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7db4ad83-c0e9-4e67-88de-f6fef8984494 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7db4ad83-c0e9-4e67-88de-f6fef8984494 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7db4ad83-c0e9-4e67-88de-f6fef8984494 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:07 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-7db4ad83-c0e9-4e67-88de-f6fef8984494 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] HTTP exception thrown: Instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d could not be found. Apr 14 17:13:07 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-7db4ad83-c0e9-4e67-88de-f6fef8984494 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Request method failure captured: Apr 14 17:13:07 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d HTTP/1.1 Apr 14 17:13:07 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:13:07 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:13:07 user devstack@n-api.service[61933]: Connection: close Apr 14 17:13:07 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:13:07 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:13:07 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:13:07 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:13:07 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:13:07 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYdeer58jEvUR9ADIlb0N430T-Ds21-KcdHVVoui-D_EAL5w5NtUAiByINleZljOdamOoVfvloz9qBpRKJNkBB-q3J2hMItuCYI1rvO5iZ-gzcRL6EYmrivLdXp9j61AUeL3LT7o_QloEQzxw1RchmjWXo1xX65gA6Tz8oI3QnBXw6g Apr 14 17:13:07 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:13:07 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:13:07 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:13:07 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:13:07 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:13:07 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:13:07 user devstack@n-api.service[61933]: X-Project-Id: 426156fb00db428683851cf731b680d1 Apr 14 17:13:07 user devstack@n-api.service[61933]: X-Project-Name: tempest-ServersNegativeTestJSON-1832599821 Apr 14 17:13:07 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:13:07 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:13:07 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426156fb00db428683851cf731b680d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/426156fb00db428683851cf731b680d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/426156fb00db428683851cf731b680d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:13:07 user devstack@n-api.service[61933]: X-Tenant: tempest-ServersNegativeTestJSON-1832599821 Apr 14 17:13:07 user devstack@n-api.service[61933]: X-Tenant-Id: 426156fb00db428683851cf731b680d1 Apr 14 17:13:07 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1832599821 Apr 14 17:13:07 user devstack@n-api.service[61933]: X-User: tempest-ServersNegativeTestJSON-1832599821-project-member Apr 14 17:13:07 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:13:07 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:13:07 user devstack@n-api.service[61933]: X-User-Id: 0d1ea0218b044c1e94f61a07c1d14a75 Apr 14 17:13:07 user devstack@n-api.service[61933]: X-User-Name: tempest-ServersNegativeTestJSON-1832599821-project-member Apr 14 17:13:07 user devstack@n-api.service[61933]: method: > Apr 14 17:13:07 user devstack@n-api.service[61933]: exception: Instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d could not be found. Apr 14 17:13:07 user devstack@n-api.service[61933]: action_args: {'id': '3ed9bc80-9e7d-4de9-ac86-704c927b111d'} Apr 14 17:13:07 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d could not be found. Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d could not be found. Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d could not be found. Apr 14 17:13:07 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:13:07 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-7db4ad83-c0e9-4e67-88de-f6fef8984494 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] Returning 404 to user: Instance 3ed9bc80-9e7d-4de9-ac86-704c927b111d could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:13:07 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-7db4ad83-c0e9-4e67-88de-f6fef8984494 tempest-ServersNegativeTestJSON-1832599821 tempest-ServersNegativeTestJSON-1832599821-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d" status: 404 len: 111 microversion: 2.1 time: 0.033434 Apr 14 17:13:07 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 163/494] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:13:07 2023] GET /compute/v2.1/servers/3ed9bc80-9e7d-4de9-ac86-704c927b111d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:13:13 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-46ffda18-3131-4448-9c96-2ab4cfe4d56e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:13 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-46ffda18-3131-4448-9c96-2ab4cfe4d56e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-46ffda18-3131-4448-9c96-2ab4cfe4d56e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-46ffda18-3131-4448-9c96-2ab4cfe4d56e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-46ffda18-3131-4448-9c96-2ab4cfe4d56e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-46ffda18-3131-4448-9c96-2ab4cfe4d56e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-46ffda18-3131-4448-9c96-2ab4cfe4d56e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-46ffda18-3131-4448-9c96-2ab4cfe4d56e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:13 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-46ffda18-3131-4448-9c96-2ab4cfe4d56e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:13:13 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-46ffda18-3131-4448-9c96-2ab4cfe4d56e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:13:13 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-46ffda18-3131-4448-9c96-2ab4cfe4d56e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:13:13 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-46ffda18-3131-4448-9c96-2ab4cfe4d56e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" status: 200 len: 1783 microversion: 2.20 time: 0.546120 Apr 14 17:13:13 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 168/495] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:13:13 2023] GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c => generated 1783 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:13:28 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=10 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:13:28 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=18 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:13:28 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-1baafeec-3ef7-4f73-be95-528c16886f89 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:28 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-1baafeec-3ef7-4f73-be95-528c16886f89 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1baafeec-3ef7-4f73-be95-528c16886f89 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1baafeec-3ef7-4f73-be95-528c16886f89 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1baafeec-3ef7-4f73-be95-528c16886f89 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1baafeec-3ef7-4f73-be95-528c16886f89 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1baafeec-3ef7-4f73-be95-528c16886f89 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1baafeec-3ef7-4f73-be95-528c16886f89 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:29 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-1baafeec-3ef7-4f73-be95-528c16886f89 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:13:29 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-1baafeec-3ef7-4f73-be95-528c16886f89 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c01d750-5923-4b61-9f3a-17cf1142f0a5" status: 200 len: 1489 microversion: 2.1 time: 0.285121 Apr 14 17:13:29 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 165/496] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:13:28 2023] GET /compute/v2.1/servers/5c01d750-5923-4b61-9f3a-17cf1142f0a5 => generated 1489 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:13:30 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=8 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:13:30 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=17 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:13:30 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-54607516-687b-4bdb-945c-f6229870b0a2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:30 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-54607516-687b-4bdb-945c-f6229870b0a2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:30 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-54607516-687b-4bdb-945c-f6229870b0a2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:30 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-54607516-687b-4bdb-945c-f6229870b0a2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:30 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-54607516-687b-4bdb-945c-f6229870b0a2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:30 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-54607516-687b-4bdb-945c-f6229870b0a2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:30 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-54607516-687b-4bdb-945c-f6229870b0a2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:30 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-54607516-687b-4bdb-945c-f6229870b0a2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:31 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-54607516-687b-4bdb-945c-f6229870b0a2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:13:31 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-54607516-687b-4bdb-945c-f6229870b0a2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:13:31 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-54607516-687b-4bdb-945c-f6229870b0a2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:13:31 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-54607516-687b-4bdb-945c-f6229870b0a2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b" status: 200 len: 1754 microversion: 2.87 time: 0.443523 Apr 14 17:13:31 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 164/497] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:13:30 2023] GET /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b => generated 1754 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:13:36 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-4ca147c4-07ba-416d-b600-66c3f6e49926 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:36 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-4ca147c4-07ba-416d-b600-66c3f6e49926 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:36 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:13:36 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:13:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4ca147c4-07ba-416d-b600-66c3f6e49926 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4ca147c4-07ba-416d-b600-66c3f6e49926 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4ca147c4-07ba-416d-b600-66c3f6e49926 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4ca147c4-07ba-416d-b600-66c3f6e49926 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4ca147c4-07ba-416d-b600-66c3f6e49926 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4ca147c4-07ba-416d-b600-66c3f6e49926 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:36 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-4ca147c4-07ba-416d-b600-66c3f6e49926 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:13:36 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-4ca147c4-07ba-416d-b600-66c3f6e49926 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5" status: 200 len: 1535 microversion: 2.1 time: 0.536161 Apr 14 17:13:36 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 169/498] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:13:36 2023] GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5 => generated 1535 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:13:36 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-63a10a5e-cd7d-4d4f-9b22-283f8613e7a1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:36 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-63a10a5e-cd7d-4d4f-9b22-283f8613e7a1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:13:36 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-63a10a5e-cd7d-4d4f-9b22-283f8613e7a1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Searching by: {'deleted': False, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac'} {{(pid=61934) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 17:13:36 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-63a10a5e-cd7d-4d4f-9b22-283f8613e7a1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:36 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-63a10a5e-cd7d-4d4f-9b22-283f8613e7a1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:36 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-63a10a5e-cd7d-4d4f-9b22-283f8613e7a1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:36 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-63a10a5e-cd7d-4d4f-9b22-283f8613e7a1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:36 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-63a10a5e-cd7d-4d4f-9b22-283f8613e7a1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:36 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-63a10a5e-cd7d-4d4f-9b22-283f8613e7a1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:36 user devstack@n-api.service[61934]: DEBUG nova.compute.multi_cell_list [None req-63a10a5e-cd7d-4d4f-9b22-283f8613e7a1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61934) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 17:13:36 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-63a10a5e-cd7d-4d4f-9b22-283f8613e7a1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.286504 Apr 14 17:13:36 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 166/499] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 17:13:36 2023] GET /compute/v2.1/servers => generated 341 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:13:36 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-3f447994-f2a6-4538-bade-7f5e9fb7dfe0 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:36 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-3f447994-f2a6-4538-bade-7f5e9fb7dfe0 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3f447994-f2a6-4538-bade-7f5e9fb7dfe0 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3f447994-f2a6-4538-bade-7f5e9fb7dfe0 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3f447994-f2a6-4538-bade-7f5e9fb7dfe0 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3f447994-f2a6-4538-bade-7f5e9fb7dfe0 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3f447994-f2a6-4538-bade-7f5e9fb7dfe0 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3f447994-f2a6-4538-bade-7f5e9fb7dfe0 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:37 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-3f447994-f2a6-4538-bade-7f5e9fb7dfe0 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:13:37 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-3f447994-f2a6-4538-bade-7f5e9fb7dfe0 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5" status: 200 len: 1535 microversion: 2.1 time: 0.260303 Apr 14 17:13:37 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 165/500] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:13:36 2023] GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5 => generated 1535 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:13:39 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d702ef9d-11a4-4a6f-81c8-6d132b21f55f"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:39 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:40 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-43c8bd67-17cb-4350-b044-d5aa5f5165ac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "POST /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303463 Apr 14 17:13:40 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 170/501] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:13:39 2023] POST /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:13:49 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:13:49 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:13:49 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=14 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:13:49 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2011999242", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "networks": [{"uuid": "e0777a60-b3a9-4754-b081-75d81284a3fd"}]}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:49 user devstack@n-api.service[61934]: DEBUG nova.network.neutron [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] validate_networks() for [('e0777a60-b3a9-4754-b081-75d81284a3fd', None, None, None, None, None)] {{(pid=61934) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:13:50 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:13:50 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:13:50 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:13:50 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:13:50 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:13:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:50 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Getting quotas for project 65ed93a0cc2a4b2689cd9d26b7f73a14. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:13:50 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Getting quotas for user 8312ebadc8bf438dbc01dc42c6257a08 and project 65ed93a0cc2a4b2689cd9d26b7f73a14. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:13:50 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Going to run 1 instances... {{(pid=61934) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:13:50 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:13:50 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-8718e110-e83b-4481-aad2-199b9406bc6a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.986594 Apr 14 17:13:50 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 167/502] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:13:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:13:50 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-2e512c21-7e3b-4167-84bb-967f83712303 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:50 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-2e512c21-7e3b-4167-84bb-967f83712303 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:50 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:13:50 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=12 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:13:50 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-2e512c21-7e3b-4167-84bb-967f83712303 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8312ebadc8bf438dbc01dc42c6257a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ed93a0cc2a4b2689cd9d26b7f73a14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:13:50 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-2e512c21-7e3b-4167-84bb-967f83712303 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64126eba-a43a-4dfe-922b-fc89b1fc8d05" status: 200 len: 1208 microversion: 2.1 time: 0.132167 Apr 14 17:13:50 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 166/503] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:13:50 2023] GET /compute/v2.1/servers/64126eba-a43a-4dfe-922b-fc89b1fc8d05 => generated 1208 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:13:50 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:13:51 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:13:51 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-ac27faba-c7c8-4d84-9ae7-e48313641b6c tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:51 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-ac27faba-c7c8-4d84-9ae7-e48313641b6c tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ac27faba-c7c8-4d84-9ae7-e48313641b6c tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ac27faba-c7c8-4d84-9ae7-e48313641b6c tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ac27faba-c7c8-4d84-9ae7-e48313641b6c tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ac27faba-c7c8-4d84-9ae7-e48313641b6c tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ac27faba-c7c8-4d84-9ae7-e48313641b6c tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ac27faba-c7c8-4d84-9ae7-e48313641b6c tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:51 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-ac27faba-c7c8-4d84-9ae7-e48313641b6c tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] HTTP exception thrown: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. Apr 14 17:13:51 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-ac27faba-c7c8-4d84-9ae7-e48313641b6c tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Request method failure captured: Apr 14 17:13:51 user devstack@n-api.service[61935]: request: GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac HTTP/1.1 Apr 14 17:13:51 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:13:51 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:13:51 user devstack@n-api.service[61935]: Connection: close Apr 14 17:13:51 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:13:51 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:13:51 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:13:51 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:13:51 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:13:51 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYdYtBTMjEs6wq_AX7uLwl48FezTrz7FyW6CSVOm9G6i0ttgahwJf1S74Fss_9qd0JO9t5wr7pQDv25cSrw7tI0XNOdCBZPRJQlF-w0w2Xn2ZRZ5EUArK2xGuE0HglaJJpHNyoLBzYQsp9Av8_ba24psGn8qYzpzCLzlLWiMZvDXQQQ Apr 14 17:13:51 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:13:51 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:13:51 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:13:51 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:13:51 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:13:51 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:13:51 user devstack@n-api.service[61935]: X-Project-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:13:51 user devstack@n-api.service[61935]: X-Project-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:13:51 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:13:51 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:13:51 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6f341a2096b9483787b569a59f325556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:13:51 user devstack@n-api.service[61935]: X-Tenant: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:13:51 user devstack@n-api.service[61935]: X-Tenant-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:13:51 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:13:51 user devstack@n-api.service[61935]: X-User: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:13:51 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:13:51 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:13:51 user devstack@n-api.service[61935]: X-User-Id: d9c9e0d318eb4ca49d47d620682fb00a Apr 14 17:13:51 user devstack@n-api.service[61935]: X-User-Name: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:13:51 user devstack@n-api.service[61935]: method: > Apr 14 17:13:51 user devstack@n-api.service[61935]: exception: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. Apr 14 17:13:51 user devstack@n-api.service[61935]: action_args: {'id': '7213d0b2-6eac-449b-aa4b-44088686abac'} Apr 14 17:13:51 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. Apr 14 17:13:51 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:13:51 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-ac27faba-c7c8-4d84-9ae7-e48313641b6c tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Returning 404 to user: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:13:51 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-ac27faba-c7c8-4d84-9ae7-e48313641b6c tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac" status: 404 len: 111 microversion: 2.1 time: 0.181198 Apr 14 17:13:51 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 171/504] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:13:50 2023] GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:13:51 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-5a801ce5-6d01-43fc-b428-e2999f25d662 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '.version_select at 0x7fe19ce444c0>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:51 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-5a801ce5-6d01-43fc-b428-e2999f25d662 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2060261619" status: 202 len: 0 microversion: 2.1 time: 0.024574 Apr 14 17:13:51 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 168/505] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 17:13:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2060261619 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:13:51 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-05a304d5-ce15-4497-8a14-0e2f53b44ec7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Action: 'create', calling method: .version_select at 0x7fe19cebe5f0>, body: {"keypair": {"name": "tempest-keypair-154124342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiAzZy9dK3YblixiueVEZjNo3Yf/Mse2QN0h6OPOOvKGQHCpmIShPfBNrSnB3HhcPcnWcV0+yoNiILxw9YMH9tL3wdLVIiHbJ+m1obAVawIKBAO8XvsM6rixZ+hO9LV7A=="}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:51 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-05a304d5-ce15-4497-8a14-0e2f53b44ec7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting quotas for project 6f341a2096b9483787b569a59f325556. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:13:51 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-05a304d5-ce15-4497-8a14-0e2f53b44ec7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting quotas for user d9c9e0d318eb4ca49d47d620682fb00a and project 6f341a2096b9483787b569a59f325556. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:13:51 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-05a304d5-ce15-4497-8a14-0e2f53b44ec7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051154 Apr 14 17:13:51 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 167/506] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 17:13:51 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:13:53 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-4ed5c386-8219-4c62-93ca-4eee9306c9cd req-9e3ad25c-ec92-4828-ad4c-a7822e233b65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64126eba-a43a-4dfe-922b-fc89b1fc8d05", "tag": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-4ed5c386-8219-4c62-93ca-4eee9306c9cd req-9e3ad25c-ec92-4828-ad4c-a7822e233b65 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-4ed5c386-8219-4c62-93ca-4eee9306c9cd req-9e3ad25c-ec92-4828-ad4c-a7822e233b65 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-4ed5c386-8219-4c62-93ca-4eee9306c9cd req-9e3ad25c-ec92-4828-ad4c-a7822e233b65 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:53 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-4ed5c386-8219-4c62-93ca-4eee9306c9cd req-9e3ad25c-ec92-4828-ad4c-a7822e233b65 service nova] Creating event network-changed:a7de6551-769f-44f1-8f5f-edc66e5ef5f1 for instance 64126eba-a43a-4dfe-922b-fc89b1fc8d05 on user Apr 14 17:13:53 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-4ed5c386-8219-4c62-93ca-4eee9306c9cd req-9e3ad25c-ec92-4828-ad4c-a7822e233b65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032709 Apr 14 17:13:53 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 172/507] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:13:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:13:53 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-4bee575a-a46b-4ebf-969d-aaaeabe925ed tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:53 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-4bee575a-a46b-4ebf-969d-aaaeabe925ed tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4bee575a-a46b-4ebf-969d-aaaeabe925ed tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4bee575a-a46b-4ebf-969d-aaaeabe925ed tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4bee575a-a46b-4ebf-969d-aaaeabe925ed tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4bee575a-a46b-4ebf-969d-aaaeabe925ed tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4bee575a-a46b-4ebf-969d-aaaeabe925ed tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4bee575a-a46b-4ebf-969d-aaaeabe925ed tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:53 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-4bee575a-a46b-4ebf-969d-aaaeabe925ed tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] HTTP exception thrown: Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 could not be found. Apr 14 17:13:53 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-4bee575a-a46b-4ebf-969d-aaaeabe925ed tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Request method failure captured: Apr 14 17:13:53 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97 HTTP/1.1 Apr 14 17:13:53 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:13:53 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:13:53 user devstack@n-api.service[61934]: Connection: close Apr 14 17:13:53 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:13:53 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:13:53 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:13:53 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:13:53 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:13:53 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYdagj0aZ2kyBdzzq-t7NmLbidGwm-Gar54za1bjccG-oxwngdDH4Bd6HWH_5EU0CRnV_zUBi7bQPXgivTq06vp_eDuLma_gnNqfv0S3xyizKOYigLMhhMshls117JLG1BnXbbVwf6FBEFpZUXcGmx-Ytz5ObHxDXz3lqJiqvIWOEqg Apr 14 17:13:53 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:13:53 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:13:53 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:13:53 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:13:53 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:13:53 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:13:53 user devstack@n-api.service[61934]: X-Project-Id: 0c8f6b39515e456c9f5a1affa9f79000 Apr 14 17:13:53 user devstack@n-api.service[61934]: X-Project-Name: tempest-AttachVolumeTestJSON-917907278 Apr 14 17:13:53 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:13:53 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:13:53 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c8f6b39515e456c9f5a1affa9f79000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c8f6b39515e456c9f5a1affa9f79000"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c8f6b39515e456c9f5a1affa9f79000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:13:53 user devstack@n-api.service[61934]: X-Tenant: tempest-AttachVolumeTestJSON-917907278 Apr 14 17:13:53 user devstack@n-api.service[61934]: X-Tenant-Id: 0c8f6b39515e456c9f5a1affa9f79000 Apr 14 17:13:53 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-AttachVolumeTestJSON-917907278 Apr 14 17:13:53 user devstack@n-api.service[61934]: X-User: tempest-AttachVolumeTestJSON-917907278-project-member Apr 14 17:13:53 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:13:53 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:13:53 user devstack@n-api.service[61934]: X-User-Id: d7c4734925f645248b0f9060aa78a502 Apr 14 17:13:53 user devstack@n-api.service[61934]: X-User-Name: tempest-AttachVolumeTestJSON-917907278-project-member Apr 14 17:13:53 user devstack@n-api.service[61934]: method: > Apr 14 17:13:53 user devstack@n-api.service[61934]: exception: Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 could not be found. Apr 14 17:13:53 user devstack@n-api.service[61934]: action_args: {'id': 'd68b702a-a0dc-4030-9893-87b4ef44fb97'} Apr 14 17:13:53 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 could not be found. Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 could not be found. Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 could not be found. Apr 14 17:13:53 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:13:53 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-4bee575a-a46b-4ebf-969d-aaaeabe925ed tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Returning 404 to user: Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:13:53 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-4bee575a-a46b-4ebf-969d-aaaeabe925ed tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97" status: 404 len: 111 microversion: 2.1 time: 0.029037 Apr 14 17:13:53 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 169/508] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:13:53 2023] GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:13:53 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-a26d4cd9-0654-44f5-85da-9bae4c6daa48 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '.version_select at 0x7fe19cebd1b0>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:53 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-a26d4cd9-0654-44f5-85da-9bae4c6daa48 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-953990957" status: 202 len: 0 microversion: 2.1 time: 0.026015 Apr 14 17:13:53 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 168/509] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 17:13:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-953990957 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:13:54 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1824688479", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "06f3eb05-9ead-4131-b955-af3bc09e9758"}], "security_groups": [{"name": "tempest-securitygroup--176285225"}], "key_name": "tempest-keypair-154124342", "user_data": "}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:54 user devstack@n-api.service[61935]: DEBUG nova.network.neutron [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] validate_networks() for [('06f3eb05-9ead-4131-b955-af3bc09e9758', None, None, None, None, None)] {{(pid=61935) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:13:54 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-6f840d2d-394a-4c62-86d1-9a409d856e23 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Action: 'create', calling method: .version_select at 0x7fe19cef4d30>, body: {"keypair": {"name": "tempest-keypair-1936947036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0uW0bfc2VtorRe+2+EDqsDVec89xkRAc5iKeALuOkKQ8tOYj6wSac/VyJ2lUwhS8eUsyWL9lTocWKwpfOk7Q4YvVGlOSCvR4MzeuEWa3Q8l7EFB4rmzP5clCT67VI6jQ=="}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:54 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-6f840d2d-394a-4c62-86d1-9a409d856e23 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Getting quotas for project 0c8f6b39515e456c9f5a1affa9f79000. Resources: {'key_pairs'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:13:54 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-6f840d2d-394a-4c62-86d1-9a409d856e23 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Getting quotas for user d7c4734925f645248b0f9060aa78a502 and project 0c8f6b39515e456c9f5a1affa9f79000. Resources: {'key_pairs'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:13:54 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-6f840d2d-394a-4c62-86d1-9a409d856e23 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055803 Apr 14 17:13:54 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 170/510] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 17:13:54 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:13:54 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-83c829e4-e0d4-4526-b370-7fae13c30d8e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:54 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-83c829e4-e0d4-4526-b370-7fae13c30d8e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-83c829e4-e0d4-4526-b370-7fae13c30d8e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-83c829e4-e0d4-4526-b370-7fae13c30d8e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-83c829e4-e0d4-4526-b370-7fae13c30d8e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-83c829e4-e0d4-4526-b370-7fae13c30d8e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-83c829e4-e0d4-4526-b370-7fae13c30d8e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-83c829e4-e0d4-4526-b370-7fae13c30d8e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:54 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-83c829e4-e0d4-4526-b370-7fae13c30d8e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:13:54 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-83c829e4-e0d4-4526-b370-7fae13c30d8e tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5" status: 200 len: 1581 microversion: 2.1 time: 0.258519 Apr 14 17:13:54 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 169/511] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:13:54 2023] GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5 => generated 1581 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:13:55 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-4d7a18fa-55b8-45d8-ac4f-44e5f343d787 req-63d2ae78-dfae-498e-977a-0a61ad909f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64126eba-a43a-4dfe-922b-fc89b1fc8d05", "name": "network-vif-plugged", "status": "completed", "tag": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-4d7a18fa-55b8-45d8-ac4f-44e5f343d787 req-63d2ae78-dfae-498e-977a-0a61ad909f72 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-4d7a18fa-55b8-45d8-ac4f-44e5f343d787 req-63d2ae78-dfae-498e-977a-0a61ad909f72 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-4d7a18fa-55b8-45d8-ac4f-44e5f343d787 req-63d2ae78-dfae-498e-977a-0a61ad909f72 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:55 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-4d7a18fa-55b8-45d8-ac4f-44e5f343d787 req-63d2ae78-dfae-498e-977a-0a61ad909f72 service nova] Creating event network-vif-plugged:a7de6551-769f-44f1-8f5f-edc66e5ef5f1 for instance 64126eba-a43a-4dfe-922b-fc89b1fc8d05 on user Apr 14 17:13:55 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flavor limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:13:55 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Image limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:13:55 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Flavor pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:13:55 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Image pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:13:55 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:13:55 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-4d7a18fa-55b8-45d8-ac4f-44e5f343d787 req-63d2ae78-dfae-498e-977a-0a61ad909f72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034138 Apr 14 17:13:55 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 171/512] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:13:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:13:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:55 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting quotas for project 6f341a2096b9483787b569a59f325556. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:13:55 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Getting quotas for user d9c9e0d318eb4ca49d47d620682fb00a and project 6f341a2096b9483787b569a59f325556. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:13:55 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Going to run 1 instances... {{(pid=61935) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:13:55 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:13:55 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-750c49e3-6cb7-4d4e-8166-ea628c23d536 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.312462 Apr 14 17:13:55 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 173/513] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:13:54 2023] POST /compute/v2.1/servers => generated 399 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:13:55 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-27a6c20d-7f58-43f0-9448-97c535a0dc38 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:55 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-27a6c20d-7f58-43f0-9448-97c535a0dc38 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:55 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-27a6c20d-7f58-43f0-9448-97c535a0dc38 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c9e0d318eb4ca49d47d620682fb00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f341a2096b9483787b569a59f325556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:13:55 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-27a6c20d-7f58-43f0-9448-97c535a0dc38 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860" status: 200 len: 1235 microversion: 2.1 time: 0.115128 Apr 14 17:13:55 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 170/514] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:13:55 2023] GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860 => generated 1235 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:13:57 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-fa6b105a-bab5-4fcc-b172-f65cffe0f45d req-b0e681f5-e260-4cd2-831e-d50693f6b989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64126eba-a43a-4dfe-922b-fc89b1fc8d05", "name": "network-vif-plugged", "status": "completed", "tag": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-fa6b105a-bab5-4fcc-b172-f65cffe0f45d req-b0e681f5-e260-4cd2-831e-d50693f6b989 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-fa6b105a-bab5-4fcc-b172-f65cffe0f45d req-b0e681f5-e260-4cd2-831e-d50693f6b989 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:57 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-fa6b105a-bab5-4fcc-b172-f65cffe0f45d req-b0e681f5-e260-4cd2-831e-d50693f6b989 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:57 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-fa6b105a-bab5-4fcc-b172-f65cffe0f45d req-b0e681f5-e260-4cd2-831e-d50693f6b989 service nova] Creating event network-vif-plugged:a7de6551-769f-44f1-8f5f-edc66e5ef5f1 for instance 64126eba-a43a-4dfe-922b-fc89b1fc8d05 on user Apr 14 17:13:57 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-fa6b105a-bab5-4fcc-b172-f65cffe0f45d req-b0e681f5-e260-4cd2-831e-d50693f6b989 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105033 Apr 14 17:13:57 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 172/515] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:13:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:13:57 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1995210077", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ae8c914e-554e-4cdf-b176-7ede005eb4f6"}], "security_groups": [{"name": "tempest-securitygroup--10580347"}], "key_name": "tempest-keypair-1936947036", "user_data": "}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:57 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-95a538b6-3ff1-4830-a1a1-e9cbb9957d6b req-6d3b053b-efc4-4ff0-82f8-43d240c86842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35dee18b-ac00-4f46-813e-7a7b400cdba5", "tag": "4295b114-8b6f-42e4-97c3-d6f972188a25"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-95a538b6-3ff1-4830-a1a1-e9cbb9957d6b req-6d3b053b-efc4-4ff0-82f8-43d240c86842 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-95a538b6-3ff1-4830-a1a1-e9cbb9957d6b req-6d3b053b-efc4-4ff0-82f8-43d240c86842 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-95a538b6-3ff1-4830-a1a1-e9cbb9957d6b req-6d3b053b-efc4-4ff0-82f8-43d240c86842 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:57 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-95a538b6-3ff1-4830-a1a1-e9cbb9957d6b req-6d3b053b-efc4-4ff0-82f8-43d240c86842 service nova] Creating event network-changed:4295b114-8b6f-42e4-97c3-d6f972188a25 for instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 on user Apr 14 17:13:57 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-95a538b6-3ff1-4830-a1a1-e9cbb9957d6b req-6d3b053b-efc4-4ff0-82f8-43d240c86842 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099849 Apr 14 17:13:57 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 171/516] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:13:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 17:13:57 user devstack@n-api.service[61935]: DEBUG nova.network.neutron [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] validate_networks() for [('ae8c914e-554e-4cdf-b176-7ede005eb4f6', None, None, None, None, None)] {{(pid=61935) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:13:58 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Flavor limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:13:58 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Image limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:13:58 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Flavor pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:13:58 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Image pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:13:58 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:13:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:58 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Getting quotas for project 0c8f6b39515e456c9f5a1affa9f79000. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:13:58 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Getting quotas for user d7c4734925f645248b0f9060aa78a502 and project 0c8f6b39515e456c9f5a1affa9f79000. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:13:58 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Going to run 1 instances... {{(pid=61935) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:13:58 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:13:58 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-f63c3020-6e4c-4c60-b422-defcd4577d39 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.1 time: 1.023854 Apr 14 17:13:58 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 174/517] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:13:57 2023] POST /compute/v2.1/servers => generated 398 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:13:58 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-fc1cbe6e-e397-4593-bf14-062cc87de1d5 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:58 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-fc1cbe6e-e397-4593-bf14-062cc87de1d5 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:58 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-fc1cbe6e-e397-4593-bf14-062cc87de1d5 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c4734925f645248b0f9060aa78a502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8f6b39515e456c9f5a1affa9f79000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:13:58 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-fc1cbe6e-e397-4593-bf14-062cc87de1d5 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123" status: 200 len: 1232 microversion: 2.1 time: 0.095332 Apr 14 17:13:58 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 173/518] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:13:58 2023] GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123 => generated 1232 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:13:58 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b92a14f5-11d4-49c9-8bc0-20345cda00fd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2135129576"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:58 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-b92a14f5-11d4-49c9-8bc0-20345cda00fd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b92a14f5-11d4-49c9-8bc0-20345cda00fd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b92a14f5-11d4-49c9-8bc0-20345cda00fd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b92a14f5-11d4-49c9-8bc0-20345cda00fd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b92a14f5-11d4-49c9-8bc0-20345cda00fd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b92a14f5-11d4-49c9-8bc0-20345cda00fd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b92a14f5-11d4-49c9-8bc0-20345cda00fd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:59 user devstack@n-api.service[61933]: INFO nova.network.security_group_api [None req-b92a14f5-11d4-49c9-8bc0-20345cda00fd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Adding security group 93ac81cf-aefb-4384-8a0f-e0e41ee6c027 to port 4295b114-8b6f-42e4-97c3-d6f972188a25 Apr 14 17:13:59 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-d174c0bd-1013-44d4-b734-56f7db159a0d req-f798a47f-eafe-401d-8614-c3d8cabaafee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c85ab15f-39ed-43cc-bbdf-b030dd21d860", "tag": "74eca994-ff43-4b06-89f4-fa4bae9c4b90"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:59 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-d174c0bd-1013-44d4-b734-56f7db159a0d req-f798a47f-eafe-401d-8614-c3d8cabaafee service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:59 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-d174c0bd-1013-44d4-b734-56f7db159a0d req-f798a47f-eafe-401d-8614-c3d8cabaafee service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:59 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-d174c0bd-1013-44d4-b734-56f7db159a0d req-f798a47f-eafe-401d-8614-c3d8cabaafee service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:59 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-d174c0bd-1013-44d4-b734-56f7db159a0d req-f798a47f-eafe-401d-8614-c3d8cabaafee service nova] Creating event network-changed:74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 on user Apr 14 17:13:59 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-d174c0bd-1013-44d4-b734-56f7db159a0d req-f798a47f-eafe-401d-8614-c3d8cabaafee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030330 Apr 14 17:13:59 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 175/519] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:13:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:13:59 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-b92a14f5-11d4-49c9-8bc0-20345cda00fd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "POST /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5/action" status: 202 len: 0 microversion: 2.1 time: 0.659121 Apr 14 17:13:59 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 172/520] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:13:58 2023] POST /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5/action => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:13:59 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-fc1f95ac-b761-4f7d-bcee-82f906b223e5 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:13:59 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-fc1f95ac-b761-4f7d-bcee-82f906b223e5 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:13:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fc1f95ac-b761-4f7d-bcee-82f906b223e5 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fc1f95ac-b761-4f7d-bcee-82f906b223e5 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fc1f95ac-b761-4f7d-bcee-82f906b223e5 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fc1f95ac-b761-4f7d-bcee-82f906b223e5 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fc1f95ac-b761-4f7d-bcee-82f906b223e5 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fc1f95ac-b761-4f7d-bcee-82f906b223e5 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:59 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-3ecd3fb1-586e-4e84-9284-e3eac2dc850a req-5ed47527-bcf3-4afe-9dfd-8f979e77ce12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35dee18b-ac00-4f46-813e-7a7b400cdba5", "tag": "4295b114-8b6f-42e4-97c3-d6f972188a25"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:13:59 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3ecd3fb1-586e-4e84-9284-e3eac2dc850a req-5ed47527-bcf3-4afe-9dfd-8f979e77ce12 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:13:59 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3ecd3fb1-586e-4e84-9284-e3eac2dc850a req-5ed47527-bcf3-4afe-9dfd-8f979e77ce12 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:13:59 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3ecd3fb1-586e-4e84-9284-e3eac2dc850a req-5ed47527-bcf3-4afe-9dfd-8f979e77ce12 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:13:59 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-3ecd3fb1-586e-4e84-9284-e3eac2dc850a req-5ed47527-bcf3-4afe-9dfd-8f979e77ce12 service nova] Creating event network-changed:4295b114-8b6f-42e4-97c3-d6f972188a25 for instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 on user Apr 14 17:13:59 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-3ecd3fb1-586e-4e84-9284-e3eac2dc850a req-5ed47527-bcf3-4afe-9dfd-8f979e77ce12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118822 Apr 14 17:13:59 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 176/521] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:13:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:13:59 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-fc1f95ac-b761-4f7d-bcee-82f906b223e5 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:14:00 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-fc1f95ac-b761-4f7d-bcee-82f906b223e5 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5" status: 200 len: 1747 microversion: 2.1 time: 0.415724 Apr 14 17:14:00 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 174/522] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:13:59 2023] GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5 => generated 1747 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:14:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-2bf07981-7e43-4750-a3c0-7eaf24115dac req-c40308bd-8984-41dc-82af-33eb405b5faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d06e72a-65dd-433d-bc13-6550fb85a123", "tag": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:14:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-2bf07981-7e43-4750-a3c0-7eaf24115dac req-c40308bd-8984-41dc-82af-33eb405b5faa service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-2bf07981-7e43-4750-a3c0-7eaf24115dac req-c40308bd-8984-41dc-82af-33eb405b5faa service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-2bf07981-7e43-4750-a3c0-7eaf24115dac req-c40308bd-8984-41dc-82af-33eb405b5faa service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:01 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-2bf07981-7e43-4750-a3c0-7eaf24115dac req-c40308bd-8984-41dc-82af-33eb405b5faa service nova] Creating event network-changed:e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 for instance 0d06e72a-65dd-433d-bc13-6550fb85a123 on user Apr 14 17:14:01 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-2bf07981-7e43-4750-a3c0-7eaf24115dac req-c40308bd-8984-41dc-82af-33eb405b5faa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034195 Apr 14 17:14:01 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 173/523] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:14:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:14:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c85ab15f-39ed-43cc-bbdf-b030dd21d860", "name": "network-vif-plugged", "status": "completed", "tag": "74eca994-ff43-4b06-89f4-fa4bae9c4b90"}, {"server_uuid": "c85ab15f-39ed-43cc-bbdf-b030dd21d860", "name": "network-vif-plugged", "status": "completed", "tag": "74eca994-ff43-4b06-89f4-fa4bae9c4b90"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:14:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:01 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] Creating event network-vif-plugged:74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 on user Apr 14 17:14:01 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] Creating event network-vif-plugged:74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 on user Apr 14 17:14:01 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-c02bd233-3ecc-4962-a97e-b5f69ff65c64 req-0d44fcad-6ab4-4628-a020-172b1e660536 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044958 Apr 14 17:14:01 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 177/524] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:14:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:14:02 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:14:02 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-633484cf-cb3e-4e93-b861-e1bbb3771de2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:14:02 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-633484cf-cb3e-4e93-b861-e1bbb3771de2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:14:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-633484cf-cb3e-4e93-b861-e1bbb3771de2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-633484cf-cb3e-4e93-b861-e1bbb3771de2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-633484cf-cb3e-4e93-b861-e1bbb3771de2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-633484cf-cb3e-4e93-b861-e1bbb3771de2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-633484cf-cb3e-4e93-b861-e1bbb3771de2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-633484cf-cb3e-4e93-b861-e1bbb3771de2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:03 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-633484cf-cb3e-4e93-b861-e1bbb3771de2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:14:03 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-633484cf-cb3e-4e93-b861-e1bbb3771de2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1721 microversion: 2.1 time: 0.367810 Apr 14 17:14:03 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 175/525] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:14:02 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1721 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:14:03 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-ddc3610b-8df7-493b-b092-e725bd88362c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:14:03 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-ddc3610b-8df7-493b-b092-e725bd88362c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:14:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ddc3610b-8df7-493b-b092-e725bd88362c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ddc3610b-8df7-493b-b092-e725bd88362c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ddc3610b-8df7-493b-b092-e725bd88362c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ddc3610b-8df7-493b-b092-e725bd88362c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ddc3610b-8df7-493b-b092-e725bd88362c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ddc3610b-8df7-493b-b092-e725bd88362c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:03 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:14:03 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:14:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:03 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-9353a2f7-e7a7-41b1-9ddb-392f8d8a7b1a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "POST /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5/action" status: 202 len: 0 microversion: 2.1 time: 0.125217 Apr 14 17:14:03 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 178/526] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:14:03 2023] POST /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:14:03 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-7580e47a-acce-42e2-ad7e-16cd18bad267 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:14:03 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-7580e47a-acce-42e2-ad7e-16cd18bad267 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:14:03 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7580e47a-acce-42e2-ad7e-16cd18bad267 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:03 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7580e47a-acce-42e2-ad7e-16cd18bad267 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:03 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7580e47a-acce-42e2-ad7e-16cd18bad267 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:03 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7580e47a-acce-42e2-ad7e-16cd18bad267 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:03 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7580e47a-acce-42e2-ad7e-16cd18bad267 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:03 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7580e47a-acce-42e2-ad7e-16cd18bad267 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:03 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-ddc3610b-8df7-493b-b092-e725bd88362c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:14:03 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-ddc3610b-8df7-493b-b092-e725bd88362c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1721 microversion: 2.1 time: 0.468072 Apr 14 17:14:03 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 174/527] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:14:03 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1721 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:14:03 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-7580e47a-acce-42e2-ad7e-16cd18bad267 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:14:03 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-7580e47a-acce-42e2-ad7e-16cd18bad267 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5" status: 200 len: 1749 microversion: 2.1 time: 0.258276 Apr 14 17:14:03 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 176/528] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:14:03 2023] GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5 => generated 1749 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:14:03 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-5ec6e04b-4c8a-4b99-bf72-48c96142d77b req-e3eff9e1-af01-4e55-802e-b2a4c6ef7bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d06e72a-65dd-433d-bc13-6550fb85a123", "name": "network-vif-plugged", "status": "completed", "tag": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:14:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5ec6e04b-4c8a-4b99-bf72-48c96142d77b req-e3eff9e1-af01-4e55-802e-b2a4c6ef7bcb service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5ec6e04b-4c8a-4b99-bf72-48c96142d77b req-e3eff9e1-af01-4e55-802e-b2a4c6ef7bcb service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5ec6e04b-4c8a-4b99-bf72-48c96142d77b req-e3eff9e1-af01-4e55-802e-b2a4c6ef7bcb service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:03 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-5ec6e04b-4c8a-4b99-bf72-48c96142d77b req-e3eff9e1-af01-4e55-802e-b2a4c6ef7bcb service nova] Creating event network-vif-plugged:e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 for instance 0d06e72a-65dd-433d-bc13-6550fb85a123 on user Apr 14 17:14:03 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-5ec6e04b-4c8a-4b99-bf72-48c96142d77b req-e3eff9e1-af01-4e55-802e-b2a4c6ef7bcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029451 Apr 14 17:14:03 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 179/529] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:14:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:14:04 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-805f1d0d-93b7-4fce-b633-36ed592725c2 req-f4f42d03-30b1-493e-8a8a-403088bd7dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dee18b-ac00-4f46-813e-7a7b400cdba5", "name": "network-vif-unplugged", "status": "completed", "tag": "4295b114-8b6f-42e4-97c3-d6f972188a25"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:14:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-805f1d0d-93b7-4fce-b633-36ed592725c2 req-f4f42d03-30b1-493e-8a8a-403088bd7dfa service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-805f1d0d-93b7-4fce-b633-36ed592725c2 req-f4f42d03-30b1-493e-8a8a-403088bd7dfa service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-805f1d0d-93b7-4fce-b633-36ed592725c2 req-f4f42d03-30b1-493e-8a8a-403088bd7dfa service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:04 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-805f1d0d-93b7-4fce-b633-36ed592725c2 req-f4f42d03-30b1-493e-8a8a-403088bd7dfa service nova] Creating event network-vif-unplugged:4295b114-8b6f-42e4-97c3-d6f972188a25 for instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 on user Apr 14 17:14:04 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-805f1d0d-93b7-4fce-b633-36ed592725c2 req-f4f42d03-30b1-493e-8a8a-403088bd7dfa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031907 Apr 14 17:14:04 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 175/530] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:14:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:14:05 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-b5b24f96-43b4-45e9-9d08-48e7f377ab2b req-796bb12f-e054-4ae6-a2dd-68c0081a8041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d06e72a-65dd-433d-bc13-6550fb85a123", "name": "network-vif-plugged", "status": "completed", "tag": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:14:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b5b24f96-43b4-45e9-9d08-48e7f377ab2b req-796bb12f-e054-4ae6-a2dd-68c0081a8041 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b5b24f96-43b4-45e9-9d08-48e7f377ab2b req-796bb12f-e054-4ae6-a2dd-68c0081a8041 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b5b24f96-43b4-45e9-9d08-48e7f377ab2b req-796bb12f-e054-4ae6-a2dd-68c0081a8041 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:05 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-b5b24f96-43b4-45e9-9d08-48e7f377ab2b req-796bb12f-e054-4ae6-a2dd-68c0081a8041 service nova] Creating event network-vif-plugged:e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 for instance 0d06e72a-65dd-433d-bc13-6550fb85a123 on user Apr 14 17:14:05 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-b5b24f96-43b4-45e9-9d08-48e7f377ab2b req-796bb12f-e054-4ae6-a2dd-68c0081a8041 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064457 Apr 14 17:14:05 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 177/531] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:14:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:14:06 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-59cf559d-2a32-4158-82f3-f8dca01985cd req-0c05c5a3-0c1f-401f-8d90-bdc06128bb7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dee18b-ac00-4f46-813e-7a7b400cdba5", "name": "network-vif-plugged", "status": "completed", "tag": "4295b114-8b6f-42e4-97c3-d6f972188a25"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:14:06 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-59cf559d-2a32-4158-82f3-f8dca01985cd req-0c05c5a3-0c1f-401f-8d90-bdc06128bb7c service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:06 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-59cf559d-2a32-4158-82f3-f8dca01985cd req-0c05c5a3-0c1f-401f-8d90-bdc06128bb7c service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:06 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-59cf559d-2a32-4158-82f3-f8dca01985cd req-0c05c5a3-0c1f-401f-8d90-bdc06128bb7c service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:06 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-59cf559d-2a32-4158-82f3-f8dca01985cd req-0c05c5a3-0c1f-401f-8d90-bdc06128bb7c service nova] Creating event network-vif-plugged:4295b114-8b6f-42e4-97c3-d6f972188a25 for instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 on user Apr 14 17:14:06 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-59cf559d-2a32-4158-82f3-f8dca01985cd req-0c05c5a3-0c1f-401f-8d90-bdc06128bb7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044691 Apr 14 17:14:06 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 180/532] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:14:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:14:09 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=8 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:14:09 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-8cc0b6e8-24d9-43e1-b239-8a242de5385e req-7c25c4dd-7c80-4405-bd8d-63ec5264f0ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dee18b-ac00-4f46-813e-7a7b400cdba5", "name": "network-vif-plugged", "status": "completed", "tag": "4295b114-8b6f-42e4-97c3-d6f972188a25"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:14:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-8cc0b6e8-24d9-43e1-b239-8a242de5385e req-7c25c4dd-7c80-4405-bd8d-63ec5264f0ae service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-8cc0b6e8-24d9-43e1-b239-8a242de5385e req-7c25c4dd-7c80-4405-bd8d-63ec5264f0ae service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-8cc0b6e8-24d9-43e1-b239-8a242de5385e req-7c25c4dd-7c80-4405-bd8d-63ec5264f0ae service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:10 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-8cc0b6e8-24d9-43e1-b239-8a242de5385e req-7c25c4dd-7c80-4405-bd8d-63ec5264f0ae service nova] Creating event network-vif-plugged:4295b114-8b6f-42e4-97c3-d6f972188a25 for instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 on user Apr 14 17:14:10 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-8cc0b6e8-24d9-43e1-b239-8a242de5385e req-7c25c4dd-7c80-4405-bd8d-63ec5264f0ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064554 Apr 14 17:14:10 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 176/533] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:14:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:14:12 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-a46318b3-a048-47c3-ac5d-b607d423d6a0 req-5605111d-cce3-4e57-a66d-4eda63f8c468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dee18b-ac00-4f46-813e-7a7b400cdba5", "name": "network-vif-plugged", "status": "completed", "tag": "4295b114-8b6f-42e4-97c3-d6f972188a25"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:14:12 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=12 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:14:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a46318b3-a048-47c3-ac5d-b607d423d6a0 req-5605111d-cce3-4e57-a66d-4eda63f8c468 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a46318b3-a048-47c3-ac5d-b607d423d6a0 req-5605111d-cce3-4e57-a66d-4eda63f8c468 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a46318b3-a048-47c3-ac5d-b607d423d6a0 req-5605111d-cce3-4e57-a66d-4eda63f8c468 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:12 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-a46318b3-a048-47c3-ac5d-b607d423d6a0 req-5605111d-cce3-4e57-a66d-4eda63f8c468 service nova] Creating event network-vif-plugged:4295b114-8b6f-42e4-97c3-d6f972188a25 for instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 on user Apr 14 17:14:12 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-a46318b3-a048-47c3-ac5d-b607d423d6a0 req-5605111d-cce3-4e57-a66d-4eda63f8c468 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037541 Apr 14 17:14:12 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 178/534] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:14:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:14:13 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:14:13 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=12 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:14:13 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-78018023-12ee-49ed-8adb-9d00db3d5e4c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:14:13 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-78018023-12ee-49ed-8adb-9d00db3d5e4c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:14:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-78018023-12ee-49ed-8adb-9d00db3d5e4c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-78018023-12ee-49ed-8adb-9d00db3d5e4c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-78018023-12ee-49ed-8adb-9d00db3d5e4c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-78018023-12ee-49ed-8adb-9d00db3d5e4c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-78018023-12ee-49ed-8adb-9d00db3d5e4c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-78018023-12ee-49ed-8adb-9d00db3d5e4c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:14 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-78018023-12ee-49ed-8adb-9d00db3d5e4c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/os-volume_attachments/37d0e1b4-870e-494c-bc85-ee2c56c4c81f" status: 200 len: 194 microversion: 2.20 time: 0.145323 Apr 14 17:14:14 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 181/535] 10.0.0.210 () {64 vars in 1531 bytes} [Fri Apr 14 17:14:13 2023] GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/os-volume_attachments/37d0e1b4-870e-494c-bc85-ee2c56c4c81f => generated 194 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 17:14:14 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:14:14 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:14:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:14 user devstack@n-api.service[61933]: DEBUG nova.objects.instance [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'services' on Instance uuid a0fe02ed-b8cd-43ac-9210-d36e8c90de5c {{(pid=61933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:14:14 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-f7795194-6581-4d5e-a7de-678f4c2b9f9c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/os-volume_attachments/37d0e1b4-870e-494c-bc85-ee2c56c4c81f" status: 202 len: 0 microversion: 2.20 time: 0.254738 Apr 14 17:14:14 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 177/536] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 17:14:14 2023] DELETE /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/os-volume_attachments/37d0e1b4-870e-494c-bc85-ee2c56c4c81f => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:14:14 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-ea865e4c-274f-45dd-ade2-2bfa8f9bc6e0 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:14:14 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-ea865e4c-274f-45dd-ade2-2bfa8f9bc6e0 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:14:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ea865e4c-274f-45dd-ade2-2bfa8f9bc6e0 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ea865e4c-274f-45dd-ade2-2bfa8f9bc6e0 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ea865e4c-274f-45dd-ade2-2bfa8f9bc6e0 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ea865e4c-274f-45dd-ade2-2bfa8f9bc6e0 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ea865e4c-274f-45dd-ade2-2bfa8f9bc6e0 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ea865e4c-274f-45dd-ade2-2bfa8f9bc6e0 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:14 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-ea865e4c-274f-45dd-ade2-2bfa8f9bc6e0 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056733 Apr 14 17:14:14 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 179/537] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 17:14:14 2023] GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 17:14:29 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-06105d63-a10b-4138-9228-374537e69382 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:14:29 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-06105d63-a10b-4138-9228-374537e69382 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:14:29 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:14:29 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:14:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-06105d63-a10b-4138-9228-374537e69382 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-06105d63-a10b-4138-9228-374537e69382 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-06105d63-a10b-4138-9228-374537e69382 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-06105d63-a10b-4138-9228-374537e69382 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-06105d63-a10b-4138-9228-374537e69382 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-06105d63-a10b-4138-9228-374537e69382 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:29 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-06105d63-a10b-4138-9228-374537e69382 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:14:29 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-06105d63-a10b-4138-9228-374537e69382 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93" status: 200 len: 1503 microversion: 2.1 time: 0.251279 Apr 14 17:14:29 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 182/538] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:14:29 2023] GET /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93 => generated 1503 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:14:31 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:14:31 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:14:31 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-70376c6c-2f03-44eb-8d06-1857a2693ae2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:14:31 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-70376c6c-2f03-44eb-8d06-1857a2693ae2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:14:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-70376c6c-2f03-44eb-8d06-1857a2693ae2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-70376c6c-2f03-44eb-8d06-1857a2693ae2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-70376c6c-2f03-44eb-8d06-1857a2693ae2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-70376c6c-2f03-44eb-8d06-1857a2693ae2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-70376c6c-2f03-44eb-8d06-1857a2693ae2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-70376c6c-2f03-44eb-8d06-1857a2693ae2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:31 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-70376c6c-2f03-44eb-8d06-1857a2693ae2 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b/action" status: 202 len: 0 microversion: 2.87 time: 0.087208 Apr 14 17:14:31 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 178/539] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 17:14:31 2023] POST /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:14:31 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-6bfad953-8ec8-40c1-9aef-25e6d2f499cc tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:14:31 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-6bfad953-8ec8-40c1-9aef-25e6d2f499cc tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:14:31 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:14:31 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=36 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:14:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6bfad953-8ec8-40c1-9aef-25e6d2f499cc tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6bfad953-8ec8-40c1-9aef-25e6d2f499cc tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6bfad953-8ec8-40c1-9aef-25e6d2f499cc tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6bfad953-8ec8-40c1-9aef-25e6d2f499cc tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6bfad953-8ec8-40c1-9aef-25e6d2f499cc tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6bfad953-8ec8-40c1-9aef-25e6d2f499cc tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:31 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-6bfad953-8ec8-40c1-9aef-25e6d2f499cc tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:14:31 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-6bfad953-8ec8-40c1-9aef-25e6d2f499cc tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:14:31 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-6bfad953-8ec8-40c1-9aef-25e6d2f499cc tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:14:31 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-6bfad953-8ec8-40c1-9aef-25e6d2f499cc tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b" status: 200 len: 1762 microversion: 2.87 time: 0.230019 Apr 14 17:14:31 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 180/540] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:14:31 2023] GET /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b => generated 1762 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:14:31 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-2a0ae104-2568-4a1f-a673-bb44bc95d62e req-6b2e88ba-8319-4588-afbc-de242f8fc116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1a580c-99da-46df-b02d-e2462d8ef26b", "name": "network-vif-unplugged", "status": "completed", "tag": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:14:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2a0ae104-2568-4a1f-a673-bb44bc95d62e req-6b2e88ba-8319-4588-afbc-de242f8fc116 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2a0ae104-2568-4a1f-a673-bb44bc95d62e req-6b2e88ba-8319-4588-afbc-de242f8fc116 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2a0ae104-2568-4a1f-a673-bb44bc95d62e req-6b2e88ba-8319-4588-afbc-de242f8fc116 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:31 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-2a0ae104-2568-4a1f-a673-bb44bc95d62e req-6b2e88ba-8319-4588-afbc-de242f8fc116 service nova] Creating event network-vif-unplugged:cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b on user Apr 14 17:14:31 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-2a0ae104-2568-4a1f-a673-bb44bc95d62e req-6b2e88ba-8319-4588-afbc-de242f8fc116 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032008 Apr 14 17:14:31 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 183/541] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:14:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:14:33 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1a580c-99da-46df-b02d-e2462d8ef26b", "name": "network-vif-plugged", "status": "completed", "tag": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d"}, {"server_uuid": "1d1a580c-99da-46df-b02d-e2462d8ef26b", "name": "network-vif-plugged", "status": "completed", "tag": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:14:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:33 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] Creating event network-vif-plugged:cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b on user Apr 14 17:14:33 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] Creating event network-vif-plugged:cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b on user Apr 14 17:14:33 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-4a841649-1e53-4cb9-b969-6296099eaaf8 req-987a5c5e-6020-4007-bec6-e2efcfd67174 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037982 Apr 14 17:14:33 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 179/542] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:14:33 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:14:35 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-e13daf0d-d963-40df-8316-43c250288ff7 req-75ac8864-8f4a-4c7d-831e-47356d3fafa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1a580c-99da-46df-b02d-e2462d8ef26b", "name": "network-vif-plugged", "status": "completed", "tag": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:14:36 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-e13daf0d-d963-40df-8316-43c250288ff7 req-75ac8864-8f4a-4c7d-831e-47356d3fafa4 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:36 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-e13daf0d-d963-40df-8316-43c250288ff7 req-75ac8864-8f4a-4c7d-831e-47356d3fafa4 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:36 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-e13daf0d-d963-40df-8316-43c250288ff7 req-75ac8864-8f4a-4c7d-831e-47356d3fafa4 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:36 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-e13daf0d-d963-40df-8316-43c250288ff7 req-75ac8864-8f4a-4c7d-831e-47356d3fafa4 service nova] Creating event network-vif-plugged:cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b on user Apr 14 17:14:36 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-e13daf0d-d963-40df-8316-43c250288ff7 req-75ac8864-8f4a-4c7d-831e-47356d3fafa4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047723 Apr 14 17:14:36 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 181/543] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:14:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:14:40 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-2a5b94b8-e0c7-4a8a-a0a5-15d89d91809a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:14:40 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-2a5b94b8-e0c7-4a8a-a0a5-15d89d91809a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:14:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2a5b94b8-e0c7-4a8a-a0a5-15d89d91809a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2a5b94b8-e0c7-4a8a-a0a5-15d89d91809a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2a5b94b8-e0c7-4a8a-a0a5-15d89d91809a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2a5b94b8-e0c7-4a8a-a0a5-15d89d91809a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2a5b94b8-e0c7-4a8a-a0a5-15d89d91809a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2a5b94b8-e0c7-4a8a-a0a5-15d89d91809a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:40 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-2a5b94b8-e0c7-4a8a-a0a5-15d89d91809a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8312ebadc8bf438dbc01dc42c6257a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ed93a0cc2a4b2689cd9d26b7f73a14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:14:40 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-2a5b94b8-e0c7-4a8a-a0a5-15d89d91809a tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64126eba-a43a-4dfe-922b-fc89b1fc8d05" status: 200 len: 1486 microversion: 2.1 time: 0.240548 Apr 14 17:14:40 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 184/544] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:14:40 2023] GET /compute/v2.1/servers/64126eba-a43a-4dfe-922b-fc89b1fc8d05 => generated 1486 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:14:45 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-cc105990-e1d4-41f7-bec2-f1a6dadad046 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:14:45 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-cc105990-e1d4-41f7-bec2-f1a6dadad046 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:14:45 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:14:45 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:14:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cc105990-e1d4-41f7-bec2-f1a6dadad046 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cc105990-e1d4-41f7-bec2-f1a6dadad046 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cc105990-e1d4-41f7-bec2-f1a6dadad046 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cc105990-e1d4-41f7-bec2-f1a6dadad046 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cc105990-e1d4-41f7-bec2-f1a6dadad046 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cc105990-e1d4-41f7-bec2-f1a6dadad046 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:45 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-cc105990-e1d4-41f7-bec2-f1a6dadad046 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c9e0d318eb4ca49d47d620682fb00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f341a2096b9483787b569a59f325556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:14:45 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-cc105990-e1d4-41f7-bec2-f1a6dadad046 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860" status: 200 len: 1545 microversion: 2.1 time: 0.238869 Apr 14 17:14:45 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 180/545] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:14:45 2023] GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860 => generated 1545 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:14:48 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:14:48 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=8 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:14:48 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-5b59746e-d130-4a0d-90e4-2fd86ab119f1 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:14:48 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-5b59746e-d130-4a0d-90e4-2fd86ab119f1 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:14:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5b59746e-d130-4a0d-90e4-2fd86ab119f1 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5b59746e-d130-4a0d-90e4-2fd86ab119f1 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5b59746e-d130-4a0d-90e4-2fd86ab119f1 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5b59746e-d130-4a0d-90e4-2fd86ab119f1 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5b59746e-d130-4a0d-90e4-2fd86ab119f1 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5b59746e-d130-4a0d-90e4-2fd86ab119f1 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:49 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-5b59746e-d130-4a0d-90e4-2fd86ab119f1 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c4734925f645248b0f9060aa78a502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8f6b39515e456c9f5a1affa9f79000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:14:49 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-5b59746e-d130-4a0d-90e4-2fd86ab119f1 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123" status: 200 len: 1535 microversion: 2.1 time: 0.306273 Apr 14 17:14:49 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 182/546] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:14:48 2023] GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123 => generated 1535 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:14:53 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-87ce4a82-bf62-4bf5-87f4-490751ffe5c9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:14:53 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-87ce4a82-bf62-4bf5-87f4-490751ffe5c9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:14:53 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:14:53 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=14 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:14:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-87ce4a82-bf62-4bf5-87f4-490751ffe5c9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-87ce4a82-bf62-4bf5-87f4-490751ffe5c9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-87ce4a82-bf62-4bf5-87f4-490751ffe5c9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-87ce4a82-bf62-4bf5-87f4-490751ffe5c9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:14:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-87ce4a82-bf62-4bf5-87f4-490751ffe5c9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:14:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-87ce4a82-bf62-4bf5-87f4-490751ffe5c9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:14:54 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-87ce4a82-bf62-4bf5-87f4-490751ffe5c9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:14:54 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-87ce4a82-bf62-4bf5-87f4-490751ffe5c9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5" status: 200 len: 1747 microversion: 2.1 time: 0.238478 Apr 14 17:14:54 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 185/547] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:14:53 2023] GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5 => generated 1747 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:15:03 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:03 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:03 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:15:03 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:15:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:03 user devstack@n-api.service[61933]: DEBUG nova.objects.instance [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lazy-loading 'services' on Instance uuid 84c02556-abf7-4832-a1b2-a2c28a7f8e52 {{(pid=61933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:15:04 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-2c5ec074-cf33-49df-a647-96311040a67d tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/os-volume_attachments/64feafc1-f567-4496-bde0-d3fa057a7728" status: 202 len: 0 microversion: 2.1 time: 0.187215 Apr 14 17:15:04 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 181/548] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:15:03 2023] DELETE /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/os-volume_attachments/64feafc1-f567-4496-bde0-d3fa057a7728 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a582c9b7-5825-488f-9a89-75a6e11ae317 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-a582c9b7-5825-488f-9a89-75a6e11ae317 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a582c9b7-5825-488f-9a89-75a6e11ae317 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a582c9b7-5825-488f-9a89-75a6e11ae317 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a582c9b7-5825-488f-9a89-75a6e11ae317 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a582c9b7-5825-488f-9a89-75a6e11ae317 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a582c9b7-5825-488f-9a89-75a6e11ae317 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a582c9b7-5825-488f-9a89-75a6e11ae317 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:04 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-a582c9b7-5825-488f-9a89-75a6e11ae317 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052024 Apr 14 17:15:04 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 183/549] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:15:04 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:04 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-f154e93f-6e71-4797-87c7-9e4b044e564a tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:04 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-f154e93f-6e71-4797-87c7-9e4b044e564a tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:04 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:15:04 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:15:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f154e93f-6e71-4797-87c7-9e4b044e564a tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f154e93f-6e71-4797-87c7-9e4b044e564a tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f154e93f-6e71-4797-87c7-9e4b044e564a tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f154e93f-6e71-4797-87c7-9e4b044e564a tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f154e93f-6e71-4797-87c7-9e4b044e564a tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f154e93f-6e71-4797-87c7-9e4b044e564a tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:04 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-f154e93f-6e71-4797-87c7-9e4b044e564a tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046775 Apr 14 17:15:04 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 186/550] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 17:15:04 2023] GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:15:04 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:04 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:04 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Going to try to terminate instance {{(pid=61933) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:15:04 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-3443eff0-5efd-49b4-9b80-41c1a7eaf869 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" status: 204 len: 0 microversion: 2.20 time: 0.112237 Apr 14 17:15:04 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 182/551] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 17:15:04 2023] DELETE /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-4643eab3-552f-41af-8e17-41f9868f5b99 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-4643eab3-552f-41af-8e17-41f9868f5b99 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4643eab3-552f-41af-8e17-41f9868f5b99 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4643eab3-552f-41af-8e17-41f9868f5b99 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4643eab3-552f-41af-8e17-41f9868f5b99 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4643eab3-552f-41af-8e17-41f9868f5b99 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4643eab3-552f-41af-8e17-41f9868f5b99 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4643eab3-552f-41af-8e17-41f9868f5b99 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-4643eab3-552f-41af-8e17-41f9868f5b99 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-4643eab3-552f-41af-8e17-41f9868f5b99 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:15:04 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-4643eab3-552f-41af-8e17-41f9868f5b99 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:15:04 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-4643eab3-552f-41af-8e17-41f9868f5b99 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" status: 200 len: 1711 microversion: 2.20 time: 0.261998 Apr 14 17:15:04 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 184/552] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:15:04 2023] GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c => generated 1711 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:15:05 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-8ea71866-d906-4993-b551-42593dbae114 req-14e30e73-4893-46bb-8015-d45240311a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c", "name": "network-vif-unplugged", "status": "completed", "tag": "f606ba05-7c5e-4e88-94ed-a44a82cb8150"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:15:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8ea71866-d906-4993-b551-42593dbae114 req-14e30e73-4893-46bb-8015-d45240311a79 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8ea71866-d906-4993-b551-42593dbae114 req-14e30e73-4893-46bb-8015-d45240311a79 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8ea71866-d906-4993-b551-42593dbae114 req-14e30e73-4893-46bb-8015-d45240311a79 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:05 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-8ea71866-d906-4993-b551-42593dbae114 req-14e30e73-4893-46bb-8015-d45240311a79 service nova] Creating event network-vif-unplugged:f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c on user Apr 14 17:15:05 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-8ea71866-d906-4993-b551-42593dbae114 req-14e30e73-4893-46bb-8015-d45240311a79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028429 Apr 14 17:15:05 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 187/553] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:15:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:07 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-2ff64aa7-5db8-4071-959f-99589b893f1d req-ed3a9590-0c46-4d10-aa37-40144d91284f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c", "name": "network-vif-plugged", "status": "completed", "tag": "f606ba05-7c5e-4e88-94ed-a44a82cb8150"}, {"server_uuid": "a0fe02ed-b8cd-43ac-9210-d36e8c90de5c", "name": "network-vif-deleted", "tag": "f606ba05-7c5e-4e88-94ed-a44a82cb8150"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:15:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-2ff64aa7-5db8-4071-959f-99589b893f1d req-ed3a9590-0c46-4d10-aa37-40144d91284f service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-2ff64aa7-5db8-4071-959f-99589b893f1d req-ed3a9590-0c46-4d10-aa37-40144d91284f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-2ff64aa7-5db8-4071-959f-99589b893f1d req-ed3a9590-0c46-4d10-aa37-40144d91284f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:07 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-2ff64aa7-5db8-4071-959f-99589b893f1d req-ed3a9590-0c46-4d10-aa37-40144d91284f service nova] Creating event network-vif-plugged:f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c on user Apr 14 17:15:07 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-2ff64aa7-5db8-4071-959f-99589b893f1d req-ed3a9590-0c46-4d10-aa37-40144d91284f service nova] Creating event network-vif-deleted:f606ba05-7c5e-4e88-94ed-a44a82cb8150 for instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c on user Apr 14 17:15:07 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-2ff64aa7-5db8-4071-959f-99589b893f1d req-ed3a9590-0c46-4d10-aa37-40144d91284f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031070 Apr 14 17:15:07 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 183/554] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:15:07 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:21 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-81b3aa50-cfb0-40c4-9634-b00357c939d4 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:21 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-81b3aa50-cfb0-40c4-9634-b00357c939d4 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:21 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:15:21 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=12 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:15:21 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-81b3aa50-cfb0-40c4-9634-b00357c939d4 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:21 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-81b3aa50-cfb0-40c4-9634-b00357c939d4 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:21 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-81b3aa50-cfb0-40c4-9634-b00357c939d4 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:21 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-81b3aa50-cfb0-40c4-9634-b00357c939d4 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:21 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-81b3aa50-cfb0-40c4-9634-b00357c939d4 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:21 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-81b3aa50-cfb0-40c4-9634-b00357c939d4 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:21 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-81b3aa50-cfb0-40c4-9634-b00357c939d4 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:15:21 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-81b3aa50-cfb0-40c4-9634-b00357c939d4 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:15:21 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-81b3aa50-cfb0-40c4-9634-b00357c939d4 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:15:21 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-81b3aa50-cfb0-40c4-9634-b00357c939d4 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b" status: 200 len: 1768 microversion: 2.87 time: 0.238979 Apr 14 17:15:21 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 185/555] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:15:21 2023] GET /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b => generated 1768 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:15:31 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:15:31 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=8 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:15:31 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:15:31 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:31 user devstack@n-api.service[61935]: DEBUG nova.objects.instance [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'flavor' on Instance uuid a075e35f-c43c-4e3a-adb2-2e1629079d93 {{(pid=61935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:15:31 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-3c9d651b-acd3-423f-a283-66ae04e49b20 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93/action" status: 200 len: 32 microversion: 2.1 time: 0.111943 Apr 14 17:15:31 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 188/556] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:15:31 2023] POST /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93/action => generated 32 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:15:31 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:15:31 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:15:31 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-38636251-c373-4044-875d-d9f6d9f5ede9 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:31 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-38636251-c373-4044-875d-d9f6d9f5ede9 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-38636251-c373-4044-875d-d9f6d9f5ede9 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-38636251-c373-4044-875d-d9f6d9f5ede9 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-38636251-c373-4044-875d-d9f6d9f5ede9 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-38636251-c373-4044-875d-d9f6d9f5ede9 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-38636251-c373-4044-875d-d9f6d9f5ede9 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-38636251-c373-4044-875d-d9f6d9f5ede9 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:32 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-38636251-c373-4044-875d-d9f6d9f5ede9 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:15:32 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-38636251-c373-4044-875d-d9f6d9f5ede9 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93" status: 200 len: 1509 microversion: 2.1 time: 0.263662 Apr 14 17:15:32 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 184/557] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:15:31 2023] GET /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93 => generated 1509 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:15:32 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-8fc250d2-c132-451a-8223-84d20a406f70 req-1b978994-924a-4594-bd85-489b15682883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a075e35f-c43c-4e3a-adb2-2e1629079d93", "name": "network-vif-unplugged", "status": "completed", "tag": "1477a3d2-85fc-4f05-83a0-156f88fc4939"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:15:32 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:15:32 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:15:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8fc250d2-c132-451a-8223-84d20a406f70 req-1b978994-924a-4594-bd85-489b15682883 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8fc250d2-c132-451a-8223-84d20a406f70 req-1b978994-924a-4594-bd85-489b15682883 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8fc250d2-c132-451a-8223-84d20a406f70 req-1b978994-924a-4594-bd85-489b15682883 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:32 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-8fc250d2-c132-451a-8223-84d20a406f70 req-1b978994-924a-4594-bd85-489b15682883 service nova] Creating event network-vif-unplugged:1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance a075e35f-c43c-4e3a-adb2-2e1629079d93 on user Apr 14 17:15:32 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-8fc250d2-c132-451a-8223-84d20a406f70 req-1b978994-924a-4594-bd85-489b15682883 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038245 Apr 14 17:15:32 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 186/558] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:15:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:34 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-5e36b39e-df54-4be4-b242-562660ccc78d req-70814748-08c1-42a8-a592-e463a91351c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a075e35f-c43c-4e3a-adb2-2e1629079d93", "name": "network-vif-plugged", "status": "completed", "tag": "1477a3d2-85fc-4f05-83a0-156f88fc4939"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:15:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5e36b39e-df54-4be4-b242-562660ccc78d req-70814748-08c1-42a8-a592-e463a91351c3 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5e36b39e-df54-4be4-b242-562660ccc78d req-70814748-08c1-42a8-a592-e463a91351c3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5e36b39e-df54-4be4-b242-562660ccc78d req-70814748-08c1-42a8-a592-e463a91351c3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:34 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-5e36b39e-df54-4be4-b242-562660ccc78d req-70814748-08c1-42a8-a592-e463a91351c3 service nova] Creating event network-vif-plugged:1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance a075e35f-c43c-4e3a-adb2-2e1629079d93 on user Apr 14 17:15:34 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-5e36b39e-df54-4be4-b242-562660ccc78d req-70814748-08c1-42a8-a592-e463a91351c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065325 Apr 14 17:15:34 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 189/559] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:15:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:36 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a075e35f-c43c-4e3a-adb2-2e1629079d93", "name": "network-vif-plugged", "status": "completed", "tag": "1477a3d2-85fc-4f05-83a0-156f88fc4939"}, {"server_uuid": "a075e35f-c43c-4e3a-adb2-2e1629079d93", "name": "network-vif-plugged", "status": "completed", "tag": "1477a3d2-85fc-4f05-83a0-156f88fc4939"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:15:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:36 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] Creating event network-vif-plugged:1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance a075e35f-c43c-4e3a-adb2-2e1629079d93 on user Apr 14 17:15:36 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] Creating event network-vif-plugged:1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance a075e35f-c43c-4e3a-adb2-2e1629079d93 on user Apr 14 17:15:36 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-1b531f4b-7a98-4ccc-84e2-75cf54d0d178 req-2ea7f92e-a0cf-4db3-92c1-d3120ad9be5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037394 Apr 14 17:15:36 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 185/560] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:15:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:41 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:41 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:41 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Going to try to terminate instance {{(pid=61934) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:15:41 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-305d393a-e6e2-4e67-b64b-5c6944036c41 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/64126eba-a43a-4dfe-922b-fc89b1fc8d05" status: 204 len: 0 microversion: 2.1 time: 0.163319 Apr 14 17:15:41 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 187/561] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:15:41 2023] DELETE /compute/v2.1/servers/64126eba-a43a-4dfe-922b-fc89b1fc8d05 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:15:41 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-10efc056-9483-410e-8a0b-c81d972e0763 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:41 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-10efc056-9483-410e-8a0b-c81d972e0763 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:41 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-10efc056-9483-410e-8a0b-c81d972e0763 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:41 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-10efc056-9483-410e-8a0b-c81d972e0763 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:41 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-10efc056-9483-410e-8a0b-c81d972e0763 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:41 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-10efc056-9483-410e-8a0b-c81d972e0763 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:41 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-10efc056-9483-410e-8a0b-c81d972e0763 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:41 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-10efc056-9483-410e-8a0b-c81d972e0763 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:41 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-7bf1a417-4e8a-494c-b8ac-c279287d6f8d req-9e63b9bd-a2af-4961-a940-d7218f2a15fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64126eba-a43a-4dfe-922b-fc89b1fc8d05", "name": "network-vif-unplugged", "status": "completed", "tag": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:15:41 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-10efc056-9483-410e-8a0b-c81d972e0763 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8312ebadc8bf438dbc01dc42c6257a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ed93a0cc2a4b2689cd9d26b7f73a14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:15:41 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-7bf1a417-4e8a-494c-b8ac-c279287d6f8d req-9e63b9bd-a2af-4961-a940-d7218f2a15fc service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:41 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-7bf1a417-4e8a-494c-b8ac-c279287d6f8d req-9e63b9bd-a2af-4961-a940-d7218f2a15fc service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:41 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-7bf1a417-4e8a-494c-b8ac-c279287d6f8d req-9e63b9bd-a2af-4961-a940-d7218f2a15fc service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:41 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-10efc056-9483-410e-8a0b-c81d972e0763 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64126eba-a43a-4dfe-922b-fc89b1fc8d05" status: 200 len: 1492 microversion: 2.1 time: 0.449270 Apr 14 17:15:41 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 190/562] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:15:41 2023] GET /compute/v2.1/servers/64126eba-a43a-4dfe-922b-fc89b1fc8d05 => generated 1492 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:15:41 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-7bf1a417-4e8a-494c-b8ac-c279287d6f8d req-9e63b9bd-a2af-4961-a940-d7218f2a15fc service nova] Creating event network-vif-unplugged:a7de6551-769f-44f1-8f5f-edc66e5ef5f1 for instance 64126eba-a43a-4dfe-922b-fc89b1fc8d05 on user Apr 14 17:15:41 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-7bf1a417-4e8a-494c-b8ac-c279287d6f8d req-9e63b9bd-a2af-4961-a940-d7218f2a15fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037381 Apr 14 17:15:41 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 186/563] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:15:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:42 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-aa47efc1-6b0e-4339-a8ef-078b928f65f9 req-8ec11ead-a05e-40fe-a88b-dc24ce7457a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64126eba-a43a-4dfe-922b-fc89b1fc8d05", "name": "network-vif-deleted", "tag": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:15:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-aa47efc1-6b0e-4339-a8ef-078b928f65f9 req-8ec11ead-a05e-40fe-a88b-dc24ce7457a3 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-aa47efc1-6b0e-4339-a8ef-078b928f65f9 req-8ec11ead-a05e-40fe-a88b-dc24ce7457a3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-aa47efc1-6b0e-4339-a8ef-078b928f65f9 req-8ec11ead-a05e-40fe-a88b-dc24ce7457a3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:42 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-aa47efc1-6b0e-4339-a8ef-078b928f65f9 req-8ec11ead-a05e-40fe-a88b-dc24ce7457a3 service nova] Creating event network-vif-deleted:a7de6551-769f-44f1-8f5f-edc66e5ef5f1 for instance 64126eba-a43a-4dfe-922b-fc89b1fc8d05 on user Apr 14 17:15:42 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-aa47efc1-6b0e-4339-a8ef-078b928f65f9 req-8ec11ead-a05e-40fe-a88b-dc24ce7457a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036240 Apr 14 17:15:42 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 188/564] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:15:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:43 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-1f7ee0bf-b8bb-4b10-9998-290aff3cc0c4 req-9804817f-273d-4e61-926a-d04b2c827001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64126eba-a43a-4dfe-922b-fc89b1fc8d05", "name": "network-vif-plugged", "status": "completed", "tag": "a7de6551-769f-44f1-8f5f-edc66e5ef5f1"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:15:43 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-1f7ee0bf-b8bb-4b10-9998-290aff3cc0c4 req-9804817f-273d-4e61-926a-d04b2c827001 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:43 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-1f7ee0bf-b8bb-4b10-9998-290aff3cc0c4 req-9804817f-273d-4e61-926a-d04b2c827001 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:43 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-1f7ee0bf-b8bb-4b10-9998-290aff3cc0c4 req-9804817f-273d-4e61-926a-d04b2c827001 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:43 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-1f7ee0bf-b8bb-4b10-9998-290aff3cc0c4 req-9804817f-273d-4e61-926a-d04b2c827001 service nova] Creating event network-vif-plugged:a7de6551-769f-44f1-8f5f-edc66e5ef5f1 for instance 64126eba-a43a-4dfe-922b-fc89b1fc8d05 on user Apr 14 17:15:43 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-1f7ee0bf-b8bb-4b10-9998-290aff3cc0c4 req-9804817f-273d-4e61-926a-d04b2c827001 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034540 Apr 14 17:15:43 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 191/565] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:15:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:45 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-fc88031f-b7ba-4933-9ade-c7850872d5ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:45 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-fc88031f-b7ba-4933-9ade-c7850872d5ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fc88031f-b7ba-4933-9ade-c7850872d5ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fc88031f-b7ba-4933-9ade-c7850872d5ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fc88031f-b7ba-4933-9ade-c7850872d5ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fc88031f-b7ba-4933-9ade-c7850872d5ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fc88031f-b7ba-4933-9ade-c7850872d5ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fc88031f-b7ba-4933-9ade-c7850872d5ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-fc88031f-b7ba-4933-9ade-c7850872d5ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.164884 Apr 14 17:15:46 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 187/566] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 17:15:45 2023] GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860/os-interface => generated 283 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:46 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-88c32a37-fd75-4c23-b685-aec0d105e26c req-5e12acfe-d5e6-4699-8fa7-7deed8cdba58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c85ab15f-39ed-43cc-bbdf-b030dd21d860", "tag": "74eca994-ff43-4b06-89f4-fa4bae9c4b90"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:15:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-88c32a37-fd75-4c23-b685-aec0d105e26c req-5e12acfe-d5e6-4699-8fa7-7deed8cdba58 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-88c32a37-fd75-4c23-b685-aec0d105e26c req-5e12acfe-d5e6-4699-8fa7-7deed8cdba58 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-88c32a37-fd75-4c23-b685-aec0d105e26c req-5e12acfe-d5e6-4699-8fa7-7deed8cdba58 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:46 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-88c32a37-fd75-4c23-b685-aec0d105e26c req-5e12acfe-d5e6-4699-8fa7-7deed8cdba58 service nova] Creating event network-changed:74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 on user Apr 14 17:15:46 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-88c32a37-fd75-4c23-b685-aec0d105e26c req-5e12acfe-d5e6-4699-8fa7-7deed8cdba58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034095 Apr 14 17:15:46 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 189/567] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:15:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:47 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-2d39686b-8113-4ad4-87bf-c242c6907428 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:47 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-2d39686b-8113-4ad4-87bf-c242c6907428 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2d39686b-8113-4ad4-87bf-c242c6907428 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2d39686b-8113-4ad4-87bf-c242c6907428 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2d39686b-8113-4ad4-87bf-c242c6907428 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2d39686b-8113-4ad4-87bf-c242c6907428 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2d39686b-8113-4ad4-87bf-c242c6907428 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2d39686b-8113-4ad4-87bf-c242c6907428 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:47 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-2d39686b-8113-4ad4-87bf-c242c6907428 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860/ips" status: 200 len: 109 microversion: 2.1 time: 0.035964 Apr 14 17:15:47 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 192/568] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 17:15:47 2023] GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860/ips => generated 109 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:49 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-7d6766aa-27b4-4753-90ae-6ab0045aec0b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:49 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-7d6766aa-27b4-4753-90ae-6ab0045aec0b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7d6766aa-27b4-4753-90ae-6ab0045aec0b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7d6766aa-27b4-4753-90ae-6ab0045aec0b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7d6766aa-27b4-4753-90ae-6ab0045aec0b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7d6766aa-27b4-4753-90ae-6ab0045aec0b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7d6766aa-27b4-4753-90ae-6ab0045aec0b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7d6766aa-27b4-4753-90ae-6ab0045aec0b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:49 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-7d6766aa-27b4-4753-90ae-6ab0045aec0b tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.163181 Apr 14 17:15:49 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 188/569] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 17:15:49 2023] GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-interface => generated 282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:49 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a7ea066-31eb-42d2-962a-3cf68651a514"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:15:49 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:49 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-352f48f1-5c74-42be-88a7-626b3654ce7d tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300456 Apr 14 17:15:49 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 190/570] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:15:49 2023] POST /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:50 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-b237f520-6d82-4c09-a5e8-7238123124b4 req-f1198e8d-25a8-4eea-9d08-5780fabd8c61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d06e72a-65dd-433d-bc13-6550fb85a123", "tag": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:15:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-b237f520-6d82-4c09-a5e8-7238123124b4 req-f1198e8d-25a8-4eea-9d08-5780fabd8c61 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-b237f520-6d82-4c09-a5e8-7238123124b4 req-f1198e8d-25a8-4eea-9d08-5780fabd8c61 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-b237f520-6d82-4c09-a5e8-7238123124b4 req-f1198e8d-25a8-4eea-9d08-5780fabd8c61 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:50 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-b237f520-6d82-4c09-a5e8-7238123124b4 req-f1198e8d-25a8-4eea-9d08-5780fabd8c61 service nova] Creating event network-changed:e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 for instance 0d06e72a-65dd-433d-bc13-6550fb85a123 on user Apr 14 17:15:50 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-b237f520-6d82-4c09-a5e8-7238123124b4 req-f1198e8d-25a8-4eea-9d08-5780fabd8c61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030398 Apr 14 17:15:50 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 193/571] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:15:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:50 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-0e80d71c-81bf-4488-99d6-f872c3c5b9c0 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:50 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-0e80d71c-81bf-4488-99d6-f872c3c5b9c0 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0e80d71c-81bf-4488-99d6-f872c3c5b9c0 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0e80d71c-81bf-4488-99d6-f872c3c5b9c0 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0e80d71c-81bf-4488-99d6-f872c3c5b9c0 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0e80d71c-81bf-4488-99d6-f872c3c5b9c0 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0e80d71c-81bf-4488-99d6-f872c3c5b9c0 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0e80d71c-81bf-4488-99d6-f872c3c5b9c0 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:50 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-0e80d71c-81bf-4488-99d6-f872c3c5b9c0 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/ips" status: 200 len: 103 microversion: 2.1 time: 0.036604 Apr 14 17:15:50 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 189/572] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 17:15:50 2023] GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/ips => generated 103 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-67007f5c-7486-49e1-b18b-6859741d5ec4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-67007f5c-7486-49e1-b18b-6859741d5ec4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-67007f5c-7486-49e1-b18b-6859741d5ec4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-67007f5c-7486-49e1-b18b-6859741d5ec4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-67007f5c-7486-49e1-b18b-6859741d5ec4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-67007f5c-7486-49e1-b18b-6859741d5ec4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-67007f5c-7486-49e1-b18b-6859741d5ec4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-67007f5c-7486-49e1-b18b-6859741d5ec4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:54 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-67007f5c-7486-49e1-b18b-6859741d5ec4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051849 Apr 14 17:15:54 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 191/573] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:15:54 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 14 17:15:54 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-2ca134fe-7c0e-4baa-b015-646e9b894147 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:54 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-2ca134fe-7c0e-4baa-b015-646e9b894147 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2ca134fe-7c0e-4baa-b015-646e9b894147 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2ca134fe-7c0e-4baa-b015-646e9b894147 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2ca134fe-7c0e-4baa-b015-646e9b894147 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2ca134fe-7c0e-4baa-b015-646e9b894147 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2ca134fe-7c0e-4baa-b015-646e9b894147 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2ca134fe-7c0e-4baa-b015-646e9b894147 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:54 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-1fb731dd-2fde-46f2-9934-80f082ffecd6 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2135129576"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:15:54 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-1fb731dd-2fde-46f2-9934-80f082ffecd6 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1fb731dd-2fde-46f2-9934-80f082ffecd6 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1fb731dd-2fde-46f2-9934-80f082ffecd6 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1fb731dd-2fde-46f2-9934-80f082ffecd6 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1fb731dd-2fde-46f2-9934-80f082ffecd6 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1fb731dd-2fde-46f2-9934-80f082ffecd6 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1fb731dd-2fde-46f2-9934-80f082ffecd6 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:54 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-2ca134fe-7c0e-4baa-b015-646e9b894147 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:15:54 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-2ca134fe-7c0e-4baa-b015-646e9b894147 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1675 microversion: 2.1 time: 0.242512 Apr 14 17:15:54 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 194/574] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:15:54 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1675 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-b29d04c3-18a4-4a61-83b0-712d45af5047 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-b29d04c3-18a4-4a61-83b0-712d45af5047 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b29d04c3-18a4-4a61-83b0-712d45af5047 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b29d04c3-18a4-4a61-83b0-712d45af5047 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b29d04c3-18a4-4a61-83b0-712d45af5047 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b29d04c3-18a4-4a61-83b0-712d45af5047 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b29d04c3-18a4-4a61-83b0-712d45af5047 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b29d04c3-18a4-4a61-83b0-712d45af5047 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:54 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcff0dc6-88c9-43a8-8210-17d7728d7e56"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:15:54 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-b29d04c3-18a4-4a61-83b0-712d45af5047 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:15:54 user devstack@n-api.service[61933]: INFO nova.network.security_group_api [None req-1fb731dd-2fde-46f2-9934-80f082ffecd6 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Removing security group 93ac81cf-aefb-4384-8a0f-e0e41ee6c027 from port 4295b114-8b6f-42e4-97c3-d6f972188a25 Apr 14 17:15:54 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-b29d04c3-18a4-4a61-83b0-712d45af5047 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1675 microversion: 2.1 time: 0.148351 Apr 14 17:15:54 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 192/575] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:15:54 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-94184d79-b09b-4ea3-be35-b44238166d6e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-94184d79-b09b-4ea3-be35-b44238166d6e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-94184d79-b09b-4ea3-be35-b44238166d6e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-94184d79-b09b-4ea3-be35-b44238166d6e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-94184d79-b09b-4ea3-be35-b44238166d6e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-94184d79-b09b-4ea3-be35-b44238166d6e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-94184d79-b09b-4ea3-be35-b44238166d6e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-94184d79-b09b-4ea3-be35-b44238166d6e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:54 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-94184d79-b09b-4ea3-be35-b44238166d6e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:15:54 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-94184d79-b09b-4ea3-be35-b44238166d6e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1675 microversion: 2.1 time: 0.164905 Apr 14 17:15:54 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 193/576] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:15:54 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:15:54 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-656289d5-f9ba-4a18-9747-a9151cd78dcc tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304524 Apr 14 17:15:54 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 195/577] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:15:54 2023] POST /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:55 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-656e9a8a-def7-4bf6-bd84-dbc3a75d0b32 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:55 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-656e9a8a-def7-4bf6-bd84-dbc3a75d0b32 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-656e9a8a-def7-4bf6-bd84-dbc3a75d0b32 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-656e9a8a-def7-4bf6-bd84-dbc3a75d0b32 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-656e9a8a-def7-4bf6-bd84-dbc3a75d0b32 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-656e9a8a-def7-4bf6-bd84-dbc3a75d0b32 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-656e9a8a-def7-4bf6-bd84-dbc3a75d0b32 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-656e9a8a-def7-4bf6-bd84-dbc3a75d0b32 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:55 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-656e9a8a-def7-4bf6-bd84-dbc3a75d0b32 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] HTTP exception thrown: Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c could not be found. Apr 14 17:15:55 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-656e9a8a-def7-4bf6-bd84-dbc3a75d0b32 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Request method failure captured: Apr 14 17:15:55 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c HTTP/1.1 Apr 14 17:15:55 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:15:55 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:15:55 user devstack@n-api.service[61934]: Connection: close Apr 14 17:15:55 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:15:55 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:15:55 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:15:55 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:15:55 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:15:55 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYiR2qMgL7kTyu29oUewuhK2BMhD1yDhsjSW-F_GgWrGh5KUHTr954Dh796RqAVsKDeAYXIov_JQ0Gk8H844eWVu4KllMwIeC7MZbuFVkr5pm_7CHOrJrhWIz7_b-q3A-nHbwyUF04SaDEpVQEXx1rxtb-bqSR-98BNEE8BrIOPN2B4 Apr 14 17:15:55 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:15:55 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:15:55 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:15:55 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:15:55 user devstack@n-api.service[61934]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 17:15:55 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:15:55 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:15:55 user devstack@n-api.service[61934]: X-Project-Id: 1ae1b41823a64cd0b1c1a1669ad202ec Apr 14 17:15:55 user devstack@n-api.service[61934]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-339689049 Apr 14 17:15:55 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:15:55 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:15:55 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ae1b41823a64cd0b1c1a1669ad202ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ae1b41823a64cd0b1c1a1669ad202ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1ae1b41823a64cd0b1c1a1669ad202ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:15:55 user devstack@n-api.service[61934]: X-Tenant: tempest-AttachVolumeShelveTestJSON-339689049 Apr 14 17:15:55 user devstack@n-api.service[61934]: X-Tenant-Id: 1ae1b41823a64cd0b1c1a1669ad202ec Apr 14 17:15:55 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-339689049 Apr 14 17:15:55 user devstack@n-api.service[61934]: X-User: tempest-AttachVolumeShelveTestJSON-339689049-project-member Apr 14 17:15:55 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:15:55 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:15:55 user devstack@n-api.service[61934]: X-User-Id: 6aa926d6cfc94b08a564404f95da5483 Apr 14 17:15:55 user devstack@n-api.service[61934]: X-User-Name: tempest-AttachVolumeShelveTestJSON-339689049-project-member Apr 14 17:15:55 user devstack@n-api.service[61934]: method: > Apr 14 17:15:55 user devstack@n-api.service[61934]: exception: Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c could not be found. Apr 14 17:15:55 user devstack@n-api.service[61934]: action_args: {'id': 'a0fe02ed-b8cd-43ac-9210-d36e8c90de5c'} Apr 14 17:15:55 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c could not be found. Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c could not be found. Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c could not be found. Apr 14 17:15:55 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:15:55 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-656e9a8a-def7-4bf6-bd84-dbc3a75d0b32 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Returning 404 to user: Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:15:55 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-656e9a8a-def7-4bf6-bd84-dbc3a75d0b32 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" status: 404 len: 111 microversion: 2.20 time: 0.047852 Apr 14 17:15:55 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 194/578] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:15:55 2023] GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:15:55 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-09913251-8a1b-4ab9-a5c4-7b9bf0e6e861 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '.version_select at 0x7fe19cfac430>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:55 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-09913251-8a1b-4ab9-a5c4-7b9bf0e6e861 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2086238855" status: 204 len: 0 microversion: 2.20 time: 0.024288 Apr 14 17:15:55 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 196/579] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 17:15:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2086238855 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 17:15:55 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-1fb731dd-2fde-46f2-9934-80f082ffecd6 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "POST /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5/action" status: 202 len: 0 microversion: 2.1 time: 0.989026 Apr 14 17:15:55 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 190/580] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:15:54 2023] POST /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5/action => generated 0 bytes in 991 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:15:55 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-81fd1010-f5d7-4320-8117-e050d13276de req-d8f41e4f-0fa2-4398-b47c-8785a81aaf71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35dee18b-ac00-4f46-813e-7a7b400cdba5", "tag": "4295b114-8b6f-42e4-97c3-d6f972188a25"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:15:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-81fd1010-f5d7-4320-8117-e050d13276de req-d8f41e4f-0fa2-4398-b47c-8785a81aaf71 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-81fd1010-f5d7-4320-8117-e050d13276de req-d8f41e4f-0fa2-4398-b47c-8785a81aaf71 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-81fd1010-f5d7-4320-8117-e050d13276de req-d8f41e4f-0fa2-4398-b47c-8785a81aaf71 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:55 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-81fd1010-f5d7-4320-8117-e050d13276de req-d8f41e4f-0fa2-4398-b47c-8785a81aaf71 service nova] Creating event network-changed:4295b114-8b6f-42e4-97c3-d6f972188a25 for instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 on user Apr 14 17:15:55 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-81fd1010-f5d7-4320-8117-e050d13276de req-d8f41e4f-0fa2-4398-b47c-8785a81aaf71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038494 Apr 14 17:15:55 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 195/581] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:15:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:56 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:56 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:56 user devstack@n-api.service[61935]: DEBUG nova.objects.instance [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'services' on Instance uuid 35dee18b-ac00-4f46-813e-7a7b400cdba5 {{(pid=61935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:15:56 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-cd0a4f40-bdd4-4c5d-b01e-4ef693eaa170 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5/os-volume_attachments/d702ef9d-11a4-4a6f-81c8-6d132b21f55f" status: 202 len: 0 microversion: 2.1 time: 0.172321 Apr 14 17:15:56 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 197/582] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:15:56 2023] DELETE /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5/os-volume_attachments/d702ef9d-11a4-4a6f-81c8-6d132b21f55f => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:15:56 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-409c6385-c5d5-424e-a143-033bb738c3e4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:56 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-409c6385-c5d5-424e-a143-033bb738c3e4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-409c6385-c5d5-424e-a143-033bb738c3e4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-409c6385-c5d5-424e-a143-033bb738c3e4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-409c6385-c5d5-424e-a143-033bb738c3e4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-409c6385-c5d5-424e-a143-033bb738c3e4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-409c6385-c5d5-424e-a143-033bb738c3e4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-409c6385-c5d5-424e-a143-033bb738c3e4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:56 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-409c6385-c5d5-424e-a143-033bb738c3e4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048216 Apr 14 17:15:56 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 191/583] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:15:56 2023] GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:56 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-bca1d85a-ce39-4368-913e-100b7ee28390 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Action: 'create', calling method: .version_select at 0x7fe19cef65f0>, body: {"keypair": {"name": "tempest-keypair-2079826628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmu0k6XkCj93lDjab3hWIuIddTxIIe6New3tssd+lQXrZvNkzrJwGACl6up5dJSwaMP2JphmLRtB0WeXyM7HltVl/Wuya2YOuiNr8wsIufy9MKTweL9xsZymU8LiqDqeA=="}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:15:56 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-bca1d85a-ce39-4368-913e-100b7ee28390 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Getting quotas for project 1ae1b41823a64cd0b1c1a1669ad202ec. Resources: {'key_pairs'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:15:56 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-bca1d85a-ce39-4368-913e-100b7ee28390 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Getting quotas for user 6aa926d6cfc94b08a564404f95da5483 and project 1ae1b41823a64cd0b1c1a1669ad202ec. Resources: {'key_pairs'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:15:56 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-bca1d85a-ce39-4368-913e-100b7ee28390 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053198 Apr 14 17:15:56 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 196/584] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 17:15:56 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 17:15:57 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-fda2830f-762d-4c13-8539-c3874441fb80 req-79553b91-b533-412b-ad76-d1b60b3e2548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35dee18b-ac00-4f46-813e-7a7b400cdba5", "tag": "4295b114-8b6f-42e4-97c3-d6f972188a25"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:15:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-fda2830f-762d-4c13-8539-c3874441fb80 req-79553b91-b533-412b-ad76-d1b60b3e2548 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-fda2830f-762d-4c13-8539-c3874441fb80 req-79553b91-b533-412b-ad76-d1b60b3e2548 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-fda2830f-762d-4c13-8539-c3874441fb80 req-79553b91-b533-412b-ad76-d1b60b3e2548 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:57 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-fda2830f-762d-4c13-8539-c3874441fb80 req-79553b91-b533-412b-ad76-d1b60b3e2548 service nova] Creating event network-changed:4295b114-8b6f-42e4-97c3-d6f972188a25 for instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 on user Apr 14 17:15:57 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-fda2830f-762d-4c13-8539-c3874441fb80 req-79553b91-b533-412b-ad76-d1b60b3e2548 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030773 Apr 14 17:15:57 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 198/585] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:15:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:58 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:58 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:58 user devstack@n-api.service[61933]: DEBUG nova.objects.instance [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lazy-loading 'services' on Instance uuid c85ab15f-39ed-43cc-bbdf-b030dd21d860 {{(pid=61933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:15:58 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1087117818", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f49ab827-654e-4ae2-838a-52bfad1c0937"}], "security_groups": [{"name": "tempest-securitygroup--1013688558"}], "key_name": "tempest-keypair-2079826628", "user_data": "}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:15:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-43e05978-3780-4506-b981-bf4a508d067a tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860/os-volume_attachments/1a7ea066-31eb-42d2-962a-3cf68651a514" status: 202 len: 0 microversion: 2.1 time: 0.164891 Apr 14 17:15:58 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 192/586] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:15:58 2023] DELETE /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860/os-volume_attachments/1a7ea066-31eb-42d2-962a-3cf68651a514 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:15:58 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-4ddea7b1-a5ce-43b1-be68-a89a0264412b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:58 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-4ddea7b1-a5ce-43b1-be68-a89a0264412b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4ddea7b1-a5ce-43b1-be68-a89a0264412b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4ddea7b1-a5ce-43b1-be68-a89a0264412b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4ddea7b1-a5ce-43b1-be68-a89a0264412b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4ddea7b1-a5ce-43b1-be68-a89a0264412b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4ddea7b1-a5ce-43b1-be68-a89a0264412b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4ddea7b1-a5ce-43b1-be68-a89a0264412b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:58 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-4ddea7b1-a5ce-43b1-be68-a89a0264412b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056142 Apr 14 17:15:58 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 199/587] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:15:58 2023] GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:15:58 user devstack@n-api.service[61934]: DEBUG nova.network.neutron [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] validate_networks() for [('f49ab827-654e-4ae2-838a-52bfad1c0937', None, None, None, None, None)] {{(pid=61934) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:15:59 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:15:59 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:15:59 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:15:59 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:15:59 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:15:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:15:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:15:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:15:59 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Getting quotas for project 1ae1b41823a64cd0b1c1a1669ad202ec. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:15:59 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Getting quotas for user 6aa926d6cfc94b08a564404f95da5483 and project 1ae1b41823a64cd0b1c1a1669ad202ec. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:15:59 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Going to run 1 instances... {{(pid=61934) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:15:59 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:15:59 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-eb96f5dd-1390-4b03-819d-a6310e0a47c5 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.693331 Apr 14 17:15:59 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 197/588] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 17:15:58 2023] POST /compute/v2.1/servers => generated 400 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 17:15:59 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-db5cbfaa-343a-4294-82e9-9f5740ac20e2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:15:59 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-db5cbfaa-343a-4294-82e9-9f5740ac20e2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:15:59 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-db5cbfaa-343a-4294-82e9-9f5740ac20e2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:15:59 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-db5cbfaa-343a-4294-82e9-9f5740ac20e2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:15:59 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-db5cbfaa-343a-4294-82e9-9f5740ac20e2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:15:59 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-db5cbfaa-343a-4294-82e9-9f5740ac20e2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd" status: 200 len: 1276 microversion: 2.20 time: 0.072151 Apr 14 17:15:59 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 193/589] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:15:59 2023] GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd => generated 1276 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:16:02 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-8b4a5b26-192a-4875-82a2-11471b1dcacf req-10ebb3d4-e307-4f80-b754-e752b55ca0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49931fa3-281e-43d0-a3e9-fde8f502b2cd", "tag": "fd88804d-f436-4656-89b3-22638cb26897"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:02 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8b4a5b26-192a-4875-82a2-11471b1dcacf req-10ebb3d4-e307-4f80-b754-e752b55ca0b7 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8b4a5b26-192a-4875-82a2-11471b1dcacf req-10ebb3d4-e307-4f80-b754-e752b55ca0b7 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8b4a5b26-192a-4875-82a2-11471b1dcacf req-10ebb3d4-e307-4f80-b754-e752b55ca0b7 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:02 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-8b4a5b26-192a-4875-82a2-11471b1dcacf req-10ebb3d4-e307-4f80-b754-e752b55ca0b7 service nova] Creating event network-changed:fd88804d-f436-4656-89b3-22638cb26897 for instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd on user Apr 14 17:16:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-8b4a5b26-192a-4875-82a2-11471b1dcacf req-10ebb3d4-e307-4f80-b754-e752b55ca0b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038483 Apr 14 17:16:02 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 200/590] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:16:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:03 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-8bb74017-29bf-438e-998f-6c2d57a93339 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:03 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-8bb74017-29bf-438e-998f-6c2d57a93339 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:03 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:03 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8bb74017-29bf-438e-998f-6c2d57a93339 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:03 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8bb74017-29bf-438e-998f-6c2d57a93339 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:03 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8bb74017-29bf-438e-998f-6c2d57a93339 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:03 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8bb74017-29bf-438e-998f-6c2d57a93339 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:03 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8bb74017-29bf-438e-998f-6c2d57a93339 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:03 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8bb74017-29bf-438e-998f-6c2d57a93339 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:03 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:03 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-8bb74017-29bf-438e-998f-6c2d57a93339 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093755 Apr 14 17:16:03 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 198/591] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:16:03 2023] GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:03 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-e35b99bc-2ecb-46af-b617-6f6c9b8111db tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:03 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-e35b99bc-2ecb-46af-b617-6f6c9b8111db tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:03 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=23 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e35b99bc-2ecb-46af-b617-6f6c9b8111db tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e35b99bc-2ecb-46af-b617-6f6c9b8111db tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e35b99bc-2ecb-46af-b617-6f6c9b8111db tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e35b99bc-2ecb-46af-b617-6f6c9b8111db tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e35b99bc-2ecb-46af-b617-6f6c9b8111db tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e35b99bc-2ecb-46af-b617-6f6c9b8111db tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:03 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:04 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-e35b99bc-2ecb-46af-b617-6f6c9b8111db tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments/fcff0dc6-88c9-43a8-8210-17d7728d7e56" status: 200 len: 194 microversion: 2.1 time: 0.086690 Apr 14 17:16:04 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 194/592] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 17:16:03 2023] GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments/fcff0dc6-88c9-43a8-8210-17d7728d7e56 => generated 194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:04 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-128a1e09-3aff-4c83-b90c-99f231098996 req-451b4b3b-9cb4-496e-9a1e-f353d6baa739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49931fa3-281e-43d0-a3e9-fde8f502b2cd", "name": "network-vif-plugged", "status": "completed", "tag": "fd88804d-f436-4656-89b3-22638cb26897"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-128a1e09-3aff-4c83-b90c-99f231098996 req-451b4b3b-9cb4-496e-9a1e-f353d6baa739 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-128a1e09-3aff-4c83-b90c-99f231098996 req-451b4b3b-9cb4-496e-9a1e-f353d6baa739 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-128a1e09-3aff-4c83-b90c-99f231098996 req-451b4b3b-9cb4-496e-9a1e-f353d6baa739 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:04 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-128a1e09-3aff-4c83-b90c-99f231098996 req-451b4b3b-9cb4-496e-9a1e-f353d6baa739 service nova] Creating event network-vif-plugged:fd88804d-f436-4656-89b3-22638cb26897 for instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd on user Apr 14 17:16:04 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-128a1e09-3aff-4c83-b90c-99f231098996 req-451b4b3b-9cb4-496e-9a1e-f353d6baa739 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040429 Apr 14 17:16:04 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 201/593] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:16:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:06 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-c09436b1-9d0b-472a-9bf5-04aed968afb7 req-0c17ddae-17d3-494d-9f57-eb980c660510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49931fa3-281e-43d0-a3e9-fde8f502b2cd", "name": "network-vif-plugged", "status": "completed", "tag": "fd88804d-f436-4656-89b3-22638cb26897"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:06 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-c09436b1-9d0b-472a-9bf5-04aed968afb7 req-0c17ddae-17d3-494d-9f57-eb980c660510 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:06 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-c09436b1-9d0b-472a-9bf5-04aed968afb7 req-0c17ddae-17d3-494d-9f57-eb980c660510 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:06 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-c09436b1-9d0b-472a-9bf5-04aed968afb7 req-0c17ddae-17d3-494d-9f57-eb980c660510 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:06 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-c09436b1-9d0b-472a-9bf5-04aed968afb7 req-0c17ddae-17d3-494d-9f57-eb980c660510 service nova] Creating event network-vif-plugged:fd88804d-f436-4656-89b3-22638cb26897 for instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd on user Apr 14 17:16:06 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-c09436b1-9d0b-472a-9bf5-04aed968afb7 req-0c17ddae-17d3-494d-9f57-eb980c660510 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040305 Apr 14 17:16:06 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 199/594] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:16:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:06 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea4a9d9c-d192-4146-9acf-97ece8fb9139"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:06 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:06 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:06 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:06 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:06 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:06 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:06 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:06 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-27b6f3b5-e925-4f93-bd59-e5e49b2d5346 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296523 Apr 14 17:16:06 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 195/595] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:16:06 2023] POST /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:14 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=3 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:14 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=3 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:14 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-1e7c5230-400c-415b-b40f-e5e732c233cd tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:14 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-1e7c5230-400c-415b-b40f-e5e732c233cd tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1e7c5230-400c-415b-b40f-e5e732c233cd tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1e7c5230-400c-415b-b40f-e5e732c233cd tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1e7c5230-400c-415b-b40f-e5e732c233cd tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1e7c5230-400c-415b-b40f-e5e732c233cd tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1e7c5230-400c-415b-b40f-e5e732c233cd tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1e7c5230-400c-415b-b40f-e5e732c233cd tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:14 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-1e7c5230-400c-415b-b40f-e5e732c233cd tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051348 Apr 14 17:16:14 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 202/596] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:16:14 2023] GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:14 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:14 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=10 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:14 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-bac7e99d-e766-4015-a8a5-9a7726a489ec tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:14 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-bac7e99d-e766-4015-a8a5-9a7726a489ec tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-bac7e99d-e766-4015-a8a5-9a7726a489ec tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-bac7e99d-e766-4015-a8a5-9a7726a489ec tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-bac7e99d-e766-4015-a8a5-9a7726a489ec tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-bac7e99d-e766-4015-a8a5-9a7726a489ec tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-bac7e99d-e766-4015-a8a5-9a7726a489ec tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-bac7e99d-e766-4015-a8a5-9a7726a489ec tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:14 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-bac7e99d-e766-4015-a8a5-9a7726a489ec tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments/fcff0dc6-88c9-43a8-8210-17d7728d7e56" status: 200 len: 194 microversion: 2.1 time: 0.053599 Apr 14 17:16:14 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 200/597] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 17:16:14 2023] GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments/fcff0dc6-88c9-43a8-8210-17d7728d7e56 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 17:16:14 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:14 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:14 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:14 user devstack@n-api.service[61933]: DEBUG nova.objects.instance [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'services' on Instance uuid 0d06e72a-65dd-433d-bc13-6550fb85a123 {{(pid=61933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:16:14 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-6baa33e7-0ff1-452d-92e3-4ac98b163770 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments/fcff0dc6-88c9-43a8-8210-17d7728d7e56" status: 202 len: 0 microversion: 2.1 time: 0.159134 Apr 14 17:16:14 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 196/598] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:16:14 2023] DELETE /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments/fcff0dc6-88c9-43a8-8210-17d7728d7e56 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:16:16 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-f178ca03-712f-4331-a2f5-76e5b241445a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:16 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-f178ca03-712f-4331-a2f5-76e5b241445a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f178ca03-712f-4331-a2f5-76e5b241445a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f178ca03-712f-4331-a2f5-76e5b241445a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f178ca03-712f-4331-a2f5-76e5b241445a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f178ca03-712f-4331-a2f5-76e5b241445a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f178ca03-712f-4331-a2f5-76e5b241445a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f178ca03-712f-4331-a2f5-76e5b241445a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:16 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-f178ca03-712f-4331-a2f5-76e5b241445a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments/ea4a9d9c-d192-4146-9acf-97ece8fb9139" status: 200 len: 194 microversion: 2.1 time: 0.040265 Apr 14 17:16:16 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 203/599] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 17:16:16 2023] GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments/ea4a9d9c-d192-4146-9acf-97ece8fb9139 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:16 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:16 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:17 user devstack@n-api.service[61934]: DEBUG nova.objects.instance [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lazy-loading 'services' on Instance uuid 0d06e72a-65dd-433d-bc13-6550fb85a123 {{(pid=61934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:16:17 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-64590b84-5959-4059-97c8-a1a696a03711 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments/ea4a9d9c-d192-4146-9acf-97ece8fb9139" status: 202 len: 0 microversion: 2.1 time: 0.224648 Apr 14 17:16:17 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 201/600] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:16:16 2023] DELETE /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments/ea4a9d9c-d192-4146-9acf-97ece8fb9139 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:16:19 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-7206ae3f-85c9-419a-9b4f-923d4a42e16e tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:19 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-7206ae3f-85c9-419a-9b4f-923d4a42e16e tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7206ae3f-85c9-419a-9b4f-923d4a42e16e tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7206ae3f-85c9-419a-9b4f-923d4a42e16e tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7206ae3f-85c9-419a-9b4f-923d4a42e16e tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7206ae3f-85c9-419a-9b4f-923d4a42e16e tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7206ae3f-85c9-419a-9b4f-923d4a42e16e tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7206ae3f-85c9-419a-9b4f-923d4a42e16e tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-7206ae3f-85c9-419a-9b4f-923d4a42e16e tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046264 Apr 14 17:16:19 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 197/601] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:16:19 2023] GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:16:19 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-8b96e2bd-7502-4a8e-9c1f-07f66fd12df6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:19 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-8b96e2bd-7502-4a8e-9c1f-07f66fd12df6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8b96e2bd-7502-4a8e-9c1f-07f66fd12df6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8b96e2bd-7502-4a8e-9c1f-07f66fd12df6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8b96e2bd-7502-4a8e-9c1f-07f66fd12df6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8b96e2bd-7502-4a8e-9c1f-07f66fd12df6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8b96e2bd-7502-4a8e-9c1f-07f66fd12df6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8b96e2bd-7502-4a8e-9c1f-07f66fd12df6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:19 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-8b96e2bd-7502-4a8e-9c1f-07f66fd12df6 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046661 Apr 14 17:16:19 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 204/602] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:16:19 2023] GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:16:19 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:19 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:19 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Going to try to terminate instance {{(pid=61934) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:16:19 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-d652b967-cb88-4505-88a8-b49d74461446 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123" status: 204 len: 0 microversion: 2.1 time: 0.124760 Apr 14 17:16:19 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 202/603] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:16:19 2023] DELETE /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:16:19 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-6d502822-a612-4c9b-afb8-e95311db22d5 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:19 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-6d502822-a612-4c9b-afb8-e95311db22d5 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6d502822-a612-4c9b-afb8-e95311db22d5 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6d502822-a612-4c9b-afb8-e95311db22d5 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6d502822-a612-4c9b-afb8-e95311db22d5 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6d502822-a612-4c9b-afb8-e95311db22d5 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6d502822-a612-4c9b-afb8-e95311db22d5 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6d502822-a612-4c9b-afb8-e95311db22d5 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:20 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-6d502822-a612-4c9b-afb8-e95311db22d5 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c4734925f645248b0f9060aa78a502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8f6b39515e456c9f5a1affa9f79000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:16:20 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-6d502822-a612-4c9b-afb8-e95311db22d5 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123" status: 200 len: 1659 microversion: 2.1 time: 0.328546 Apr 14 17:16:20 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 198/604] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:16:19 2023] GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123 => generated 1659 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:16:20 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-821729e5-4afe-443c-ae65-18085d15851c req-5746f2a6-c425-4b2b-ad61-39877ccb008e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d06e72a-65dd-433d-bc13-6550fb85a123", "name": "network-vif-unplugged", "status": "completed", "tag": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-821729e5-4afe-443c-ae65-18085d15851c req-5746f2a6-c425-4b2b-ad61-39877ccb008e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-821729e5-4afe-443c-ae65-18085d15851c req-5746f2a6-c425-4b2b-ad61-39877ccb008e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-821729e5-4afe-443c-ae65-18085d15851c req-5746f2a6-c425-4b2b-ad61-39877ccb008e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:20 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-821729e5-4afe-443c-ae65-18085d15851c req-5746f2a6-c425-4b2b-ad61-39877ccb008e service nova] Creating event network-vif-unplugged:e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 for instance 0d06e72a-65dd-433d-bc13-6550fb85a123 on user Apr 14 17:16:20 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-821729e5-4afe-443c-ae65-18085d15851c req-5746f2a6-c425-4b2b-ad61-39877ccb008e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034236 Apr 14 17:16:20 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 205/605] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:16:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:21 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-4354ea08-d5a1-481a-816b-5c29c4742c30 req-5bea0a26-9c51-4928-970f-cc4f11c3dca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d06e72a-65dd-433d-bc13-6550fb85a123", "name": "network-vif-deleted", "tag": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:21 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-4354ea08-d5a1-481a-816b-5c29c4742c30 req-5bea0a26-9c51-4928-970f-cc4f11c3dca3 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:21 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-4354ea08-d5a1-481a-816b-5c29c4742c30 req-5bea0a26-9c51-4928-970f-cc4f11c3dca3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:21 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-4354ea08-d5a1-481a-816b-5c29c4742c30 req-5bea0a26-9c51-4928-970f-cc4f11c3dca3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:21 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-4354ea08-d5a1-481a-816b-5c29c4742c30 req-5bea0a26-9c51-4928-970f-cc4f11c3dca3 service nova] Creating event network-vif-deleted:e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 for instance 0d06e72a-65dd-433d-bc13-6550fb85a123 on user Apr 14 17:16:21 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-4354ea08-d5a1-481a-816b-5c29c4742c30 req-5bea0a26-9c51-4928-970f-cc4f11c3dca3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035714 Apr 14 17:16:21 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 203/606] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:16:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:21 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-119717964", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "networks": [{"uuid": "d6985162-5d80-43b0-a99f-e724ada7fdf4"}]}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:21 user devstack@n-api.service[61933]: DEBUG nova.network.neutron [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] validate_networks() for [('d6985162-5d80-43b0-a99f-e724ada7fdf4', None, None, None, None, None)] {{(pid=61933) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:16:22 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-a8f149d5-2c31-4715-bcf7-f4f4d148e602 req-fe4451d0-fe2c-447b-a170-1bab623a86a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d06e72a-65dd-433d-bc13-6550fb85a123", "name": "network-vif-plugged", "status": "completed", "tag": "e9809ce5-c37b-4fdc-9c1b-50e204c9ad37"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-a8f149d5-2c31-4715-bcf7-f4f4d148e602 req-fe4451d0-fe2c-447b-a170-1bab623a86a8 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-a8f149d5-2c31-4715-bcf7-f4f4d148e602 req-fe4451d0-fe2c-447b-a170-1bab623a86a8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-a8f149d5-2c31-4715-bcf7-f4f4d148e602 req-fe4451d0-fe2c-447b-a170-1bab623a86a8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:22 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-a8f149d5-2c31-4715-bcf7-f4f4d148e602 req-fe4451d0-fe2c-447b-a170-1bab623a86a8 service nova] Creating event network-vif-plugged:e9809ce5-c37b-4fdc-9c1b-50e204c9ad37 for instance 0d06e72a-65dd-433d-bc13-6550fb85a123 on user Apr 14 17:16:22 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-a8f149d5-2c31-4715-bcf7-f4f4d148e602 req-fe4451d0-fe2c-447b-a170-1bab623a86a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031264 Apr 14 17:16:22 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 206/607] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:16:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:22 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-edb60b5a-98fc-4b72-a7de-22c317fee6cc tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:22 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-edb60b5a-98fc-4b72-a7de-22c317fee6cc tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-edb60b5a-98fc-4b72-a7de-22c317fee6cc tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-edb60b5a-98fc-4b72-a7de-22c317fee6cc tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-edb60b5a-98fc-4b72-a7de-22c317fee6cc tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-edb60b5a-98fc-4b72-a7de-22c317fee6cc tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-edb60b5a-98fc-4b72-a7de-22c317fee6cc tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-edb60b5a-98fc-4b72-a7de-22c317fee6cc tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:22 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:16:22 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:16:22 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:16:22 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:16:22 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:16:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:22 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Getting quotas for project 965bd22f61df40bd89e8ef35fb12bcd3. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:16:22 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Getting quotas for user b5c86125160643958349100fb3a7855b and project 965bd22f61df40bd89e8ef35fb12bcd3. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:16:22 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Going to run 1 instances... {{(pid=61933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:16:22 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:16:22 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-8843155d-1458-440a-942e-1153f7b24365 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.634940 Apr 14 17:16:22 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 199/608] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 17:16:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 17:16:22 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-0fc6348e-8cb4-4a4f-9048-8b25d9e2ae3e tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:22 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-0fc6348e-8cb4-4a4f-9048-8b25d9e2ae3e tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:22 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-0fc6348e-8cb4-4a4f-9048-8b25d9e2ae3e tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:16:22 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-0fc6348e-8cb4-4a4f-9048-8b25d9e2ae3e tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:16:22 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-0fc6348e-8cb4-4a4f-9048-8b25d9e2ae3e tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:16:22 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-0fc6348e-8cb4-4a4f-9048-8b25d9e2ae3e tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3e1f09c-567e-41d1-9c35-58b8371a1d1c" status: 200 len: 1394 microversion: 2.87 time: 0.382663 Apr 14 17:16:22 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 207/609] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:16:22 2023] GET /compute/v2.1/servers/a3e1f09c-567e-41d1-9c35-58b8371a1d1c => generated 1394 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 17:16:23 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-edb60b5a-98fc-4b72-a7de-22c317fee6cc tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:16:23 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-edb60b5a-98fc-4b72-a7de-22c317fee6cc tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93" status: 200 len: 1489 microversion: 2.1 time: 0.769965 Apr 14 17:16:23 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 204/610] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:16:22 2023] GET /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93 => generated 1489 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:16:25 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-1c817208-7fee-4aef-9bc0-673d60927d18 req-0ef0d71a-6a33-4557-bc9e-b3c9ed5d0cfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3e1f09c-567e-41d1-9c35-58b8371a1d1c", "tag": "26192624-8026-443e-8abd-c2890d04fd77"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:25 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-1c817208-7fee-4aef-9bc0-673d60927d18 req-0ef0d71a-6a33-4557-bc9e-b3c9ed5d0cfa service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:25 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-1c817208-7fee-4aef-9bc0-673d60927d18 req-0ef0d71a-6a33-4557-bc9e-b3c9ed5d0cfa service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:25 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-1c817208-7fee-4aef-9bc0-673d60927d18 req-0ef0d71a-6a33-4557-bc9e-b3c9ed5d0cfa service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:25 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-1c817208-7fee-4aef-9bc0-673d60927d18 req-0ef0d71a-6a33-4557-bc9e-b3c9ed5d0cfa service nova] Creating event network-changed:26192624-8026-443e-8abd-c2890d04fd77 for instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c on user Apr 14 17:16:25 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-1c817208-7fee-4aef-9bc0-673d60927d18 req-0ef0d71a-6a33-4557-bc9e-b3c9ed5d0cfa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029866 Apr 14 17:16:25 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 200/611] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:16:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:27 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-47e7f98e-4619-48a0-9709-adda75a3d2e8 req-5785dee0-c10c-4d64-b886-85c5cfb3412e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e1f09c-567e-41d1-9c35-58b8371a1d1c", "name": "network-vif-plugged", "status": "completed", "tag": "26192624-8026-443e-8abd-c2890d04fd77"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:27 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-47e7f98e-4619-48a0-9709-adda75a3d2e8 req-5785dee0-c10c-4d64-b886-85c5cfb3412e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:27 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-47e7f98e-4619-48a0-9709-adda75a3d2e8 req-5785dee0-c10c-4d64-b886-85c5cfb3412e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:27 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-47e7f98e-4619-48a0-9709-adda75a3d2e8 req-5785dee0-c10c-4d64-b886-85c5cfb3412e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:27 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-47e7f98e-4619-48a0-9709-adda75a3d2e8 req-5785dee0-c10c-4d64-b886-85c5cfb3412e service nova] Creating event network-vif-plugged:26192624-8026-443e-8abd-c2890d04fd77 for instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c on user Apr 14 17:16:27 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-47e7f98e-4619-48a0-9709-adda75a3d2e8 req-5785dee0-c10c-4d64-b886-85c5cfb3412e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029980 Apr 14 17:16:27 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 208/612] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:16:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:29 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-c7b9794c-30e7-4845-acb3-8600eba548b3 req-d4bfbbe4-1d51-4ec8-9f83-8d9d97b3b65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e1f09c-567e-41d1-9c35-58b8371a1d1c", "name": "network-vif-plugged", "status": "completed", "tag": "26192624-8026-443e-8abd-c2890d04fd77"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-c7b9794c-30e7-4845-acb3-8600eba548b3 req-d4bfbbe4-1d51-4ec8-9f83-8d9d97b3b65b service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-c7b9794c-30e7-4845-acb3-8600eba548b3 req-d4bfbbe4-1d51-4ec8-9f83-8d9d97b3b65b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-c7b9794c-30e7-4845-acb3-8600eba548b3 req-d4bfbbe4-1d51-4ec8-9f83-8d9d97b3b65b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:29 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-c7b9794c-30e7-4845-acb3-8600eba548b3 req-d4bfbbe4-1d51-4ec8-9f83-8d9d97b3b65b service nova] Creating event network-vif-plugged:26192624-8026-443e-8abd-c2890d04fd77 for instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c on user Apr 14 17:16:29 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-c7b9794c-30e7-4845-acb3-8600eba548b3 req-d4bfbbe4-1d51-4ec8-9f83-8d9d97b3b65b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048610 Apr 14 17:16:29 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 205/613] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:16:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:31 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-ce110e74-257e-48a2-908f-eca191a18817 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:31 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-ce110e74-257e-48a2-908f-eca191a18817 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: 64126eba-a43a-4dfe-922b-fc89b1fc8d05] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ce110e74-257e-48a2-908f-eca191a18817 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ce110e74-257e-48a2-908f-eca191a18817 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ce110e74-257e-48a2-908f-eca191a18817 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ce110e74-257e-48a2-908f-eca191a18817 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ce110e74-257e-48a2-908f-eca191a18817 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ce110e74-257e-48a2-908f-eca191a18817 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:31 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-ce110e74-257e-48a2-908f-eca191a18817 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] HTTP exception thrown: Instance 64126eba-a43a-4dfe-922b-fc89b1fc8d05 could not be found. Apr 14 17:16:31 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-ce110e74-257e-48a2-908f-eca191a18817 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Request method failure captured: Apr 14 17:16:31 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/64126eba-a43a-4dfe-922b-fc89b1fc8d05 HTTP/1.1 Apr 14 17:16:31 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:16:31 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:16:31 user devstack@n-api.service[61933]: Connection: close Apr 14 17:16:31 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:16:31 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:16:31 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:16:31 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:16:31 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:16:31 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYnKJQiLmhT7OGJNFozbdGXQz1Z6uqduyk0QAtkwY2NFOYUu0dUZ_o_mQ2hsdhh8l-VHeMSV-eZOPTHS4AFDvkn_BB7TkIh6_Vw3w8k9_Gk_sZTNf4Lc-J-1lnxJgTkdWE29iLF9qYiPcgUql14UJEfERRUwVUMlSyO3A8W-Zhv-Cwk Apr 14 17:16:31 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:16:31 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:16:31 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:16:31 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:16:31 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:16:31 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:16:31 user devstack@n-api.service[61933]: X-Project-Id: 65ed93a0cc2a4b2689cd9d26b7f73a14 Apr 14 17:16:31 user devstack@n-api.service[61933]: X-Project-Name: tempest-VolumesActionsTest-355349757 Apr 14 17:16:31 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:16:31 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:16:31 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65ed93a0cc2a4b2689cd9d26b7f73a14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65ed93a0cc2a4b2689cd9d26b7f73a14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65ed93a0cc2a4b2689cd9d26b7f73a14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:16:31 user devstack@n-api.service[61933]: X-Tenant: tempest-VolumesActionsTest-355349757 Apr 14 17:16:31 user devstack@n-api.service[61933]: X-Tenant-Id: 65ed93a0cc2a4b2689cd9d26b7f73a14 Apr 14 17:16:31 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-VolumesActionsTest-355349757 Apr 14 17:16:31 user devstack@n-api.service[61933]: X-User: tempest-VolumesActionsTest-355349757-project-member Apr 14 17:16:31 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:16:31 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:16:31 user devstack@n-api.service[61933]: X-User-Id: 8312ebadc8bf438dbc01dc42c6257a08 Apr 14 17:16:31 user devstack@n-api.service[61933]: X-User-Name: tempest-VolumesActionsTest-355349757-project-member Apr 14 17:16:31 user devstack@n-api.service[61933]: method: > Apr 14 17:16:31 user devstack@n-api.service[61933]: exception: Instance 64126eba-a43a-4dfe-922b-fc89b1fc8d05 could not be found. Apr 14 17:16:31 user devstack@n-api.service[61933]: action_args: {'id': '64126eba-a43a-4dfe-922b-fc89b1fc8d05'} Apr 14 17:16:31 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64126eba-a43a-4dfe-922b-fc89b1fc8d05 could not be found. Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64126eba-a43a-4dfe-922b-fc89b1fc8d05 could not be found. Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64126eba-a43a-4dfe-922b-fc89b1fc8d05 could not be found. Apr 14 17:16:31 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:16:31 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-ce110e74-257e-48a2-908f-eca191a18817 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Returning 404 to user: Instance 64126eba-a43a-4dfe-922b-fc89b1fc8d05 could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:16:31 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-ce110e74-257e-48a2-908f-eca191a18817 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64126eba-a43a-4dfe-922b-fc89b1fc8d05" status: 404 len: 111 microversion: 2.1 time: 0.032063 Apr 14 17:16:31 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 201/614] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:16:31 2023] GET /compute/v2.1/servers/64126eba-a43a-4dfe-922b-fc89b1fc8d05 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:16:31 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-510926440", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "networks": [{"uuid": "e0777a60-b3a9-4754-b081-75d81284a3fd"}]}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:32 user devstack@n-api.service[61935]: DEBUG nova.network.neutron [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] validate_networks() for [('e0777a60-b3a9-4754-b081-75d81284a3fd', None, None, None, None, None)] {{(pid=61935) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:16:32 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Flavor limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:16:32 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Image limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:16:32 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Flavor pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:16:32 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Image pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:16:32 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:16:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:32 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Getting quotas for project 65ed93a0cc2a4b2689cd9d26b7f73a14. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:16:32 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Getting quotas for user 8312ebadc8bf438dbc01dc42c6257a08 and project 65ed93a0cc2a4b2689cd9d26b7f73a14. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:16:32 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Going to run 1 instances... {{(pid=61935) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:16:32 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:16:32 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-0ab5b6f7-acf2-4b65-b2d7-2f5b3b6f6678 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.640164 Apr 14 17:16:32 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 209/615] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:16:31 2023] POST /compute/v2.1/servers => generated 378 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:16:32 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-786e9c73-5f49-423c-958d-37bca2ff389d tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:32 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-786e9c73-5f49-423c-958d-37bca2ff389d tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:32 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-786e9c73-5f49-423c-958d-37bca2ff389d tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8312ebadc8bf438dbc01dc42c6257a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ed93a0cc2a4b2689cd9d26b7f73a14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:16:32 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-786e9c73-5f49-423c-958d-37bca2ff389d tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5dd90e8-4232-4f87-ac96-a5a142e3370c" status: 200 len: 1207 microversion: 2.1 time: 0.066404 Apr 14 17:16:32 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 206/616] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:16:32 2023] GET /compute/v2.1/servers/d5dd90e8-4232-4f87-ac96-a5a142e3370c => generated 1207 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:16:35 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-62a1df3c-879e-418d-bc3a-c9b189869150 req-5358c9f1-35cf-4b9d-a2ef-5594474eea45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5dd90e8-4232-4f87-ac96-a5a142e3370c", "tag": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:35 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:35 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:35 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-62a1df3c-879e-418d-bc3a-c9b189869150 req-5358c9f1-35cf-4b9d-a2ef-5594474eea45 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-62a1df3c-879e-418d-bc3a-c9b189869150 req-5358c9f1-35cf-4b9d-a2ef-5594474eea45 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-62a1df3c-879e-418d-bc3a-c9b189869150 req-5358c9f1-35cf-4b9d-a2ef-5594474eea45 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:35 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:35 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-62a1df3c-879e-418d-bc3a-c9b189869150 req-5358c9f1-35cf-4b9d-a2ef-5594474eea45 service nova] Creating event network-changed:130d0e48-7ee6-4fe7-9a2d-7ef5042e966b for instance d5dd90e8-4232-4f87-ac96-a5a142e3370c on user Apr 14 17:16:35 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-62a1df3c-879e-418d-bc3a-c9b189869150 req-5358c9f1-35cf-4b9d-a2ef-5594474eea45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047025 Apr 14 17:16:35 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 202/617] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:16:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:37 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-c84af6e8-7c25-4a64-a6c2-568540b61e8c req-eb01eb9e-ef1c-4ad5-b810-d7a7d0ab4c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5dd90e8-4232-4f87-ac96-a5a142e3370c", "name": "network-vif-plugged", "status": "completed", "tag": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c84af6e8-7c25-4a64-a6c2-568540b61e8c req-eb01eb9e-ef1c-4ad5-b810-d7a7d0ab4c45 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c84af6e8-7c25-4a64-a6c2-568540b61e8c req-eb01eb9e-ef1c-4ad5-b810-d7a7d0ab4c45 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c84af6e8-7c25-4a64-a6c2-568540b61e8c req-eb01eb9e-ef1c-4ad5-b810-d7a7d0ab4c45 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:37 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c84af6e8-7c25-4a64-a6c2-568540b61e8c req-eb01eb9e-ef1c-4ad5-b810-d7a7d0ab4c45 service nova] Creating event network-vif-plugged:130d0e48-7ee6-4fe7-9a2d-7ef5042e966b for instance d5dd90e8-4232-4f87-ac96-a5a142e3370c on user Apr 14 17:16:37 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-c84af6e8-7c25-4a64-a6c2-568540b61e8c req-eb01eb9e-ef1c-4ad5-b810-d7a7d0ab4c45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037843 Apr 14 17:16:37 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 210/618] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:16:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:39 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-ec310921-1eaf-4eb2-8977-6cbb3e0c329f req-7da68feb-0123-4224-a673-c46cf4aff9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5dd90e8-4232-4f87-ac96-a5a142e3370c", "name": "network-vif-plugged", "status": "completed", "tag": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:39 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:39 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:39 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ec310921-1eaf-4eb2-8977-6cbb3e0c329f req-7da68feb-0123-4224-a673-c46cf4aff9d2 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:39 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ec310921-1eaf-4eb2-8977-6cbb3e0c329f req-7da68feb-0123-4224-a673-c46cf4aff9d2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:39 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ec310921-1eaf-4eb2-8977-6cbb3e0c329f req-7da68feb-0123-4224-a673-c46cf4aff9d2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:39 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-ec310921-1eaf-4eb2-8977-6cbb3e0c329f req-7da68feb-0123-4224-a673-c46cf4aff9d2 service nova] Creating event network-vif-plugged:130d0e48-7ee6-4fe7-9a2d-7ef5042e966b for instance d5dd90e8-4232-4f87-ac96-a5a142e3370c on user Apr 14 17:16:39 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-ec310921-1eaf-4eb2-8977-6cbb3e0c329f req-7da68feb-0123-4224-a673-c46cf4aff9d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036966 Apr 14 17:16:39 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 207/619] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:16:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:46 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:46 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-35a071d5-1515-4069-bf71-6ce332590533 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:46 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-35a071d5-1515-4069-bf71-6ce332590533 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-35a071d5-1515-4069-bf71-6ce332590533 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-35a071d5-1515-4069-bf71-6ce332590533 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-35a071d5-1515-4069-bf71-6ce332590533 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-35a071d5-1515-4069-bf71-6ce332590533 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-35a071d5-1515-4069-bf71-6ce332590533 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-35a071d5-1515-4069-bf71-6ce332590533 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-35a071d5-1515-4069-bf71-6ce332590533 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.143503 Apr 14 17:16:46 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 203/620] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:16:46 2023] GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:16:46 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-6b58cda6-be4e-44de-aaae-1747d27a4cac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:46 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-6b58cda6-be4e-44de-aaae-1747d27a4cac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:46 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:46 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=8 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:46 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-6b58cda6-be4e-44de-aaae-1747d27a4cac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-6b58cda6-be4e-44de-aaae-1747d27a4cac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-6b58cda6-be4e-44de-aaae-1747d27a4cac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-6b58cda6-be4e-44de-aaae-1747d27a4cac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-6b58cda6-be4e-44de-aaae-1747d27a4cac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-6b58cda6-be4e-44de-aaae-1747d27a4cac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:46 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=29 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:46 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-6b58cda6-be4e-44de-aaae-1747d27a4cac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] HTTP exception thrown: Instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 is not attached to volume d702ef9d-11a4-4a6f-81c8-6d132b21f55f Apr 14 17:16:46 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-6b58cda6-be4e-44de-aaae-1747d27a4cac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Request method failure captured: Apr 14 17:16:46 user devstack@n-api.service[61935]: request: DELETE /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5/os-volume_attachments/d702ef9d-11a4-4a6f-81c8-6d132b21f55f HTTP/1.1 Apr 14 17:16:46 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:16:46 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:16:46 user devstack@n-api.service[61935]: Connection: close Apr 14 17:16:46 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:16:46 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:16:46 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:16:46 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:16:46 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:16:46 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYlH8oeecSNmWpcptJ7XQIg_czFAdoxZlEn7n9bZMWzl2Cey_zb44KiBPB5hBZCJuPRxZS0tzBAMtnKhqqdQ2MYOjUj8RmHi4TQSQ-tS3z_yl5OsJr6EVti0XIm87vd_6aqqJws-eEBXEZwCnCAh-boDeWVkYEkG4ObXm2GgFk8-T-M Apr 14 17:16:46 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:16:46 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:16:46 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:16:46 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:16:46 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:16:46 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:16:46 user devstack@n-api.service[61935]: X-Project-Id: 0a92a4f922f442a88cfb86f8239e52ac Apr 14 17:16:46 user devstack@n-api.service[61935]: X-Project-Name: tempest-TestMinimumBasicScenario-1645387059 Apr 14 17:16:46 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:16:46 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:16:46 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a92a4f922f442a88cfb86f8239e52ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a92a4f922f442a88cfb86f8239e52ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0a92a4f922f442a88cfb86f8239e52ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:16:46 user devstack@n-api.service[61935]: X-Tenant: tempest-TestMinimumBasicScenario-1645387059 Apr 14 17:16:46 user devstack@n-api.service[61935]: X-Tenant-Id: 0a92a4f922f442a88cfb86f8239e52ac Apr 14 17:16:46 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1645387059 Apr 14 17:16:46 user devstack@n-api.service[61935]: X-User: tempest-TestMinimumBasicScenario-1645387059-project-member Apr 14 17:16:46 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:16:46 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:16:46 user devstack@n-api.service[61935]: X-User-Id: 4bd0842f11b0499298e2af46ad659962 Apr 14 17:16:46 user devstack@n-api.service[61935]: X-User-Name: tempest-TestMinimumBasicScenario-1645387059-project-member Apr 14 17:16:46 user devstack@n-api.service[61935]: method: > Apr 14 17:16:46 user devstack@n-api.service[61935]: exception: Instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 is not attached to volume d702ef9d-11a4-4a6f-81c8-6d132b21f55f Apr 14 17:16:46 user devstack@n-api.service[61935]: action_args: {'server_id': '35dee18b-ac00-4f46-813e-7a7b400cdba5', 'id': 'd702ef9d-11a4-4a6f-81c8-6d132b21f55f'} Apr 14 17:16:46 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d702ef9d-11a4-4a6f-81c8-6d132b21f55f. Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 is not attached to volume d702ef9d-11a4-4a6f-81c8-6d132b21f55f Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 is not attached to volume d702ef9d-11a4-4a6f-81c8-6d132b21f55f Apr 14 17:16:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:16:46 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-6b58cda6-be4e-44de-aaae-1747d27a4cac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Returning 404 to user: Instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 is not attached to volume d702ef9d-11a4-4a6f-81c8-6d132b21f55f {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:16:46 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-6b58cda6-be4e-44de-aaae-1747d27a4cac tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5/os-volume_attachments/d702ef9d-11a4-4a6f-81c8-6d132b21f55f" status: 404 len: 154 microversion: 2.1 time: 0.113219 Apr 14 17:16:46 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 211/621] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:16:46 2023] DELETE /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5/os-volume_attachments/d702ef9d-11a4-4a6f-81c8-6d132b21f55f => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:16:48 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:16:48 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-44456e88-17e1-4369-b7fb-6d525a9ec795 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:48 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-44456e88-17e1-4369-b7fb-6d525a9ec795 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-44456e88-17e1-4369-b7fb-6d525a9ec795 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-44456e88-17e1-4369-b7fb-6d525a9ec795 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-44456e88-17e1-4369-b7fb-6d525a9ec795 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-44456e88-17e1-4369-b7fb-6d525a9ec795 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-44456e88-17e1-4369-b7fb-6d525a9ec795 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-44456e88-17e1-4369-b7fb-6d525a9ec795 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:48 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-44456e88-17e1-4369-b7fb-6d525a9ec795 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050682 Apr 14 17:16:48 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 208/622] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:16:48 2023] GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:16:48 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:48 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:48 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Going to try to terminate instance {{(pid=61933) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:16:49 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d6f7edc7-c084-4707-a0b6-3c54716ec409 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860" status: 204 len: 0 microversion: 2.1 time: 0.124902 Apr 14 17:16:49 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 204/623] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:16:48 2023] DELETE /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:16:49 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-0197a1c6-2a58-425f-92be-c8d879275b1b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:49 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-0197a1c6-2a58-425f-92be-c8d879275b1b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0197a1c6-2a58-425f-92be-c8d879275b1b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0197a1c6-2a58-425f-92be-c8d879275b1b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0197a1c6-2a58-425f-92be-c8d879275b1b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0197a1c6-2a58-425f-92be-c8d879275b1b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0197a1c6-2a58-425f-92be-c8d879275b1b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0197a1c6-2a58-425f-92be-c8d879275b1b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:49 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-3b487d9a-bd68-4f55-a248-ea69a22af551 req-cbf5286c-c34e-41a2-a6a9-818b9659619a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c85ab15f-39ed-43cc-bbdf-b030dd21d860", "name": "network-vif-unplugged", "status": "completed", "tag": "74eca994-ff43-4b06-89f4-fa4bae9c4b90"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3b487d9a-bd68-4f55-a248-ea69a22af551 req-cbf5286c-c34e-41a2-a6a9-818b9659619a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3b487d9a-bd68-4f55-a248-ea69a22af551 req-cbf5286c-c34e-41a2-a6a9-818b9659619a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3b487d9a-bd68-4f55-a248-ea69a22af551 req-cbf5286c-c34e-41a2-a6a9-818b9659619a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:49 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-3b487d9a-bd68-4f55-a248-ea69a22af551 req-cbf5286c-c34e-41a2-a6a9-818b9659619a service nova] Creating event network-vif-unplugged:74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 on user Apr 14 17:16:49 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-3b487d9a-bd68-4f55-a248-ea69a22af551 req-cbf5286c-c34e-41a2-a6a9-818b9659619a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034564 Apr 14 17:16:49 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 209/624] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:16:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:49 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-0197a1c6-2a58-425f-92be-c8d879275b1b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c9e0d318eb4ca49d47d620682fb00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f341a2096b9483787b569a59f325556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:16:49 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-0197a1c6-2a58-425f-92be-c8d879275b1b tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860" status: 200 len: 1670 microversion: 2.1 time: 0.330979 Apr 14 17:16:49 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 212/625] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:16:49 2023] GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860 => generated 1670 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:16:49 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-3e063608-491c-4a5d-8c51-56b30cbcd9dc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:49 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-3e063608-491c-4a5d-8c51-56b30cbcd9dc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3e063608-491c-4a5d-8c51-56b30cbcd9dc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3e063608-491c-4a5d-8c51-56b30cbcd9dc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3e063608-491c-4a5d-8c51-56b30cbcd9dc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3e063608-491c-4a5d-8c51-56b30cbcd9dc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3e063608-491c-4a5d-8c51-56b30cbcd9dc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3e063608-491c-4a5d-8c51-56b30cbcd9dc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:49 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-3e063608-491c-4a5d-8c51-56b30cbcd9dc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:16:49 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-3e063608-491c-4a5d-8c51-56b30cbcd9dc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:16:49 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-3e063608-491c-4a5d-8c51-56b30cbcd9dc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:16:49 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-3e063608-491c-4a5d-8c51-56b30cbcd9dc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd" status: 200 len: 1588 microversion: 2.20 time: 0.291135 Apr 14 17:16:49 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 205/626] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:16:49 2023] GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd => generated 1588 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:16:50 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:50 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:50 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Going to try to terminate instance {{(pid=61934) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:16:50 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-b1767d93-5246-455a-8186-cbcd597f06c8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5" status: 204 len: 0 microversion: 2.1 time: 0.161230 Apr 14 17:16:50 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 210/627] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:16:50 2023] DELETE /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:16:50 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-1a82e0b1-77e5-4619-8ae0-d69cbf71105d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:50 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-1a82e0b1-77e5-4619-8ae0-d69cbf71105d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1a82e0b1-77e5-4619-8ae0-d69cbf71105d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1a82e0b1-77e5-4619-8ae0-d69cbf71105d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1a82e0b1-77e5-4619-8ae0-d69cbf71105d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1a82e0b1-77e5-4619-8ae0-d69cbf71105d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1a82e0b1-77e5-4619-8ae0-d69cbf71105d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1a82e0b1-77e5-4619-8ae0-d69cbf71105d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:50 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-1a82e0b1-77e5-4619-8ae0-d69cbf71105d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:16:50 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-1a82e0b1-77e5-4619-8ae0-d69cbf71105d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5" status: 200 len: 1541 microversion: 2.1 time: 0.303907 Apr 14 17:16:50 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 213/628] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:16:50 2023] GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5 => generated 1541 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:16:50 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-665f1a9e-5d5c-4020-8ae9-12a2ff0f868b req-e84187b7-da5d-4e37-b4e3-1e9a40ba2d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dee18b-ac00-4f46-813e-7a7b400cdba5", "name": "network-vif-unplugged", "status": "completed", "tag": "4295b114-8b6f-42e4-97c3-d6f972188a25"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-665f1a9e-5d5c-4020-8ae9-12a2ff0f868b req-e84187b7-da5d-4e37-b4e3-1e9a40ba2d92 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-665f1a9e-5d5c-4020-8ae9-12a2ff0f868b req-e84187b7-da5d-4e37-b4e3-1e9a40ba2d92 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-665f1a9e-5d5c-4020-8ae9-12a2ff0f868b req-e84187b7-da5d-4e37-b4e3-1e9a40ba2d92 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:50 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-665f1a9e-5d5c-4020-8ae9-12a2ff0f868b req-e84187b7-da5d-4e37-b4e3-1e9a40ba2d92 service nova] Creating event network-vif-unplugged:4295b114-8b6f-42e4-97c3-d6f972188a25 for instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 on user Apr 14 17:16:50 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-665f1a9e-5d5c-4020-8ae9-12a2ff0f868b req-e84187b7-da5d-4e37-b4e3-1e9a40ba2d92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053319 Apr 14 17:16:50 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 206/629] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:16:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:51 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-57201756-67b7-4e58-babc-f11bc4fd488f req-b92d26e5-4b8f-49e7-820e-642071e8535b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c85ab15f-39ed-43cc-bbdf-b030dd21d860", "name": "network-vif-deleted", "tag": "74eca994-ff43-4b06-89f4-fa4bae9c4b90"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:51 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-57201756-67b7-4e58-babc-f11bc4fd488f req-b92d26e5-4b8f-49e7-820e-642071e8535b service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:51 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-57201756-67b7-4e58-babc-f11bc4fd488f req-b92d26e5-4b8f-49e7-820e-642071e8535b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:51 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-57201756-67b7-4e58-babc-f11bc4fd488f req-b92d26e5-4b8f-49e7-820e-642071e8535b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:51 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-57201756-67b7-4e58-babc-f11bc4fd488f req-b92d26e5-4b8f-49e7-820e-642071e8535b service nova] Creating event network-vif-deleted:74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 on user Apr 14 17:16:51 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-57201756-67b7-4e58-babc-f11bc4fd488f req-b92d26e5-4b8f-49e7-820e-642071e8535b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032377 Apr 14 17:16:51 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 211/630] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:16:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:51 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c85ab15f-39ed-43cc-bbdf-b030dd21d860", "name": "network-vif-plugged", "status": "completed", "tag": "74eca994-ff43-4b06-89f4-fa4bae9c4b90"}, {"server_uuid": "c85ab15f-39ed-43cc-bbdf-b030dd21d860", "name": "network-vif-plugged", "status": "completed", "tag": "74eca994-ff43-4b06-89f4-fa4bae9c4b90"}, {"server_uuid": "c85ab15f-39ed-43cc-bbdf-b030dd21d860", "name": "network-vif-plugged", "status": "completed", "tag": "74eca994-ff43-4b06-89f4-fa4bae9c4b90"}, {"server_uuid": "c85ab15f-39ed-43cc-bbdf-b030dd21d860", "name": "network-vif-unplugged", "status": "completed", "tag": "74eca994-ff43-4b06-89f4-fa4bae9c4b90"}, {"server_uuid": "c85ab15f-39ed-43cc-bbdf-b030dd21d860", "name": "network-vif-plugged", "status": "completed", "tag": "74eca994-ff43-4b06-89f4-fa4bae9c4b90"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:51 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Creating event network-vif-plugged:74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 on user Apr 14 17:16:51 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Creating event network-vif-plugged:74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 on user Apr 14 17:16:51 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Creating event network-vif-plugged:74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 on user Apr 14 17:16:51 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Creating event network-vif-unplugged:74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 on user Apr 14 17:16:51 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] Creating event network-vif-plugged:74eca994-ff43-4b06-89f4-fa4bae9c4b90 for instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 on user Apr 14 17:16:51 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-c5496d56-5935-4533-9c51-b429e5ceac15 req-a2873087-fbea-4a45-810f-f61a3f29f269 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.037373 Apr 14 17:16:51 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 214/631] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:16:51 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:52 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-c945a6e7-6f2e-4941-85d8-7535733c3895 req-770b2716-9ebc-4249-96e9-ee6d158cf54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dee18b-ac00-4f46-813e-7a7b400cdba5", "name": "network-vif-plugged", "status": "completed", "tag": "4295b114-8b6f-42e4-97c3-d6f972188a25"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c945a6e7-6f2e-4941-85d8-7535733c3895 req-770b2716-9ebc-4249-96e9-ee6d158cf54b service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c945a6e7-6f2e-4941-85d8-7535733c3895 req-770b2716-9ebc-4249-96e9-ee6d158cf54b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c945a6e7-6f2e-4941-85d8-7535733c3895 req-770b2716-9ebc-4249-96e9-ee6d158cf54b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:52 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-c945a6e7-6f2e-4941-85d8-7535733c3895 req-770b2716-9ebc-4249-96e9-ee6d158cf54b service nova] Creating event network-vif-plugged:4295b114-8b6f-42e4-97c3-d6f972188a25 for instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 on user Apr 14 17:16:52 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-c945a6e7-6f2e-4941-85d8-7535733c3895 req-770b2716-9ebc-4249-96e9-ee6d158cf54b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031694 Apr 14 17:16:52 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 207/632] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:16:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:53 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-8963f8ba-a8e6-4794-924c-e9ecd5886681 req-30be082a-feaf-441c-a0e7-4b594fe5483d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dee18b-ac00-4f46-813e-7a7b400cdba5", "name": "network-vif-deleted", "tag": "4295b114-8b6f-42e4-97c3-d6f972188a25"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8963f8ba-a8e6-4794-924c-e9ecd5886681 req-30be082a-feaf-441c-a0e7-4b594fe5483d service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8963f8ba-a8e6-4794-924c-e9ecd5886681 req-30be082a-feaf-441c-a0e7-4b594fe5483d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8963f8ba-a8e6-4794-924c-e9ecd5886681 req-30be082a-feaf-441c-a0e7-4b594fe5483d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:53 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-8963f8ba-a8e6-4794-924c-e9ecd5886681 req-30be082a-feaf-441c-a0e7-4b594fe5483d service nova] Creating event network-vif-deleted:4295b114-8b6f-42e4-97c3-d6f972188a25 for instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 on user Apr 14 17:16:53 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-8963f8ba-a8e6-4794-924c-e9ecd5886681 req-30be082a-feaf-441c-a0e7-4b594fe5483d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030072 Apr 14 17:16:53 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 212/633] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:16:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:16:57 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-d140ce92-c8fe-4abe-b02b-f0c8131694f7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:16:57 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-d140ce92-c8fe-4abe-b02b-f0c8131694f7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d140ce92-c8fe-4abe-b02b-f0c8131694f7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d140ce92-c8fe-4abe-b02b-f0c8131694f7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d140ce92-c8fe-4abe-b02b-f0c8131694f7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d140ce92-c8fe-4abe-b02b-f0c8131694f7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d140ce92-c8fe-4abe-b02b-f0c8131694f7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d140ce92-c8fe-4abe-b02b-f0c8131694f7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:57 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-d140ce92-c8fe-4abe-b02b-f0c8131694f7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:16:57 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-d140ce92-c8fe-4abe-b02b-f0c8131694f7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1675 microversion: 2.1 time: 0.259070 Apr 14 17:16:57 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 215/634] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:16:57 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1675 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:16:58 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc2e1bba-01b7-42d9-8760-d569da7c4fae"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:16:58 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:16:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:16:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:16:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:16:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-e8b1d092-c04c-49f4-95d3-63c7d4cd1ab8 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "POST /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303145 Apr 14 17:16:58 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 208/635] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:16:57 2023] POST /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:17:05 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:17:05 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:17:05 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:17:05 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:05 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:17:05 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Old instance type m1.nano, new instance type m1.micro {{(pid=61934) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 17:17:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:06 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting quotas for project 978cd1b4b6434b298731b01dac02591c. Resources: {'cores', 'ram'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:17:06 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting quotas for user a22398c18fcc48aca2f0f9691f1c1143 and project 978cd1b4b6434b298731b01dac02591c. Resources: {'cores', 'ram'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:17:06 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:17:06 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:17:06 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:17:06 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:17:06 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:17:06 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-349bd48c-c847-4ef9-b2c0-8f04bd3534f5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "POST /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/action" status: 202 len: 0 microversion: 2.1 time: 0.293213 Apr 14 17:17:06 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 213/636] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:17:05 2023] POST /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:17:06 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-1baa66c0-e2d6-461b-93c9-c3b4ab77c31f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:06 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-1baa66c0-e2d6-461b-93c9-c3b4ab77c31f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:06 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1baa66c0-e2d6-461b-93c9-c3b4ab77c31f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:06 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1baa66c0-e2d6-461b-93c9-c3b4ab77c31f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:06 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1baa66c0-e2d6-461b-93c9-c3b4ab77c31f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:06 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1baa66c0-e2d6-461b-93c9-c3b4ab77c31f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:06 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1baa66c0-e2d6-461b-93c9-c3b4ab77c31f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:06 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1baa66c0-e2d6-461b-93c9-c3b4ab77c31f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:06 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-1baa66c0-e2d6-461b-93c9-c3b4ab77c31f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:17:06 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-1baa66c0-e2d6-461b-93c9-c3b4ab77c31f tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1730 microversion: 2.1 time: 0.232592 Apr 14 17:17:06 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 216/637] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:17:06 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:17:08 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:17:08 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:17:08 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-58079a5f-581e-424f-8617-f2b97485ff29 req-7d9134c9-4ccf-44f0-b4a1-ef7a210ef1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "name": "network-vif-unplugged", "status": "completed", "tag": "de268504-352a-4d08-8113-a2098b794478"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:17:08 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-58079a5f-581e-424f-8617-f2b97485ff29 req-7d9134c9-4ccf-44f0-b4a1-ef7a210ef1e9 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:08 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-58079a5f-581e-424f-8617-f2b97485ff29 req-7d9134c9-4ccf-44f0-b4a1-ef7a210ef1e9 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:08 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-58079a5f-581e-424f-8617-f2b97485ff29 req-7d9134c9-4ccf-44f0-b4a1-ef7a210ef1e9 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:08 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-58079a5f-581e-424f-8617-f2b97485ff29 req-7d9134c9-4ccf-44f0-b4a1-ef7a210ef1e9 service nova] Creating event network-vif-unplugged:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:17:08 user devstack@n-api.service[61933]: DEBUG nova.compute.api [req-58079a5f-581e-424f-8617-f2b97485ff29 req-7d9134c9-4ccf-44f0-b4a1-ef7a210ef1e9 service nova] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61933) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 17:17:08 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-58079a5f-581e-424f-8617-f2b97485ff29 req-7d9134c9-4ccf-44f0-b4a1-ef7a210ef1e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055574 Apr 14 17:17:08 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 209/638] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:17:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 17:17:10 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-c914986d-ce22-47f8-8b58-7bf7325bb06a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:10 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-c914986d-ce22-47f8-8b58-7bf7325bb06a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c914986d-ce22-47f8-8b58-7bf7325bb06a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c914986d-ce22-47f8-8b58-7bf7325bb06a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c914986d-ce22-47f8-8b58-7bf7325bb06a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c914986d-ce22-47f8-8b58-7bf7325bb06a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c914986d-ce22-47f8-8b58-7bf7325bb06a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c914986d-ce22-47f8-8b58-7bf7325bb06a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:10 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-c914986d-ce22-47f8-8b58-7bf7325bb06a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] HTTP exception thrown: Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 could not be found. Apr 14 17:17:10 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-c914986d-ce22-47f8-8b58-7bf7325bb06a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Request method failure captured: Apr 14 17:17:10 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123 HTTP/1.1 Apr 14 17:17:10 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:17:10 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:17:10 user devstack@n-api.service[61934]: Connection: close Apr 14 17:17:10 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:17:10 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:17:10 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:17:10 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:17:10 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:17:10 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYdagj0aZ2kyBdzzq-t7NmLbidGwm-Gar54za1bjccG-oxwngdDH4Bd6HWH_5EU0CRnV_zUBi7bQPXgivTq06vp_eDuLma_gnNqfv0S3xyizKOYigLMhhMshls117JLG1BnXbbVwf6FBEFpZUXcGmx-Ytz5ObHxDXz3lqJiqvIWOEqg Apr 14 17:17:10 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:17:10 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:17:10 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:17:10 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:17:10 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:17:10 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:17:10 user devstack@n-api.service[61934]: X-Project-Id: 0c8f6b39515e456c9f5a1affa9f79000 Apr 14 17:17:10 user devstack@n-api.service[61934]: X-Project-Name: tempest-AttachVolumeTestJSON-917907278 Apr 14 17:17:10 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:17:10 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:17:10 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c8f6b39515e456c9f5a1affa9f79000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c8f6b39515e456c9f5a1affa9f79000"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c8f6b39515e456c9f5a1affa9f79000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:17:10 user devstack@n-api.service[61934]: X-Tenant: tempest-AttachVolumeTestJSON-917907278 Apr 14 17:17:10 user devstack@n-api.service[61934]: X-Tenant-Id: 0c8f6b39515e456c9f5a1affa9f79000 Apr 14 17:17:10 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-AttachVolumeTestJSON-917907278 Apr 14 17:17:10 user devstack@n-api.service[61934]: X-User: tempest-AttachVolumeTestJSON-917907278-project-member Apr 14 17:17:10 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:17:10 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:17:10 user devstack@n-api.service[61934]: X-User-Id: d7c4734925f645248b0f9060aa78a502 Apr 14 17:17:10 user devstack@n-api.service[61934]: X-User-Name: tempest-AttachVolumeTestJSON-917907278-project-member Apr 14 17:17:10 user devstack@n-api.service[61934]: method: > Apr 14 17:17:10 user devstack@n-api.service[61934]: exception: Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 could not be found. Apr 14 17:17:10 user devstack@n-api.service[61934]: action_args: {'id': '0d06e72a-65dd-433d-bc13-6550fb85a123'} Apr 14 17:17:10 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 could not be found. Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 could not be found. Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 could not be found. Apr 14 17:17:10 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:17:10 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-c914986d-ce22-47f8-8b58-7bf7325bb06a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Returning 404 to user: Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:17:10 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-c914986d-ce22-47f8-8b58-7bf7325bb06a tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123" status: 404 len: 111 microversion: 2.1 time: 0.027727 Apr 14 17:17:10 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 214/639] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:17:10 2023] GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:17:10 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-7a6e5ddb-2e86-45cd-9d1f-e27cfacd37a4 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '.version_select at 0x7fe19cd180d0>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:10 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-7a6e5ddb-2e86-45cd-9d1f-e27cfacd37a4 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1936947036" status: 202 len: 0 microversion: 2.1 time: 0.026461 Apr 14 17:17:10 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 217/640] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 17:17:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1936947036 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:17:10 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-6c1e29e6-3d6d-4eb5-b14f-55f3da845078 req-f657a91e-a9f6-42e6-a78f-8f69252f4957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "name": "network-vif-plugged", "status": "completed", "tag": "de268504-352a-4d08-8113-a2098b794478"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:17:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-6c1e29e6-3d6d-4eb5-b14f-55f3da845078 req-f657a91e-a9f6-42e6-a78f-8f69252f4957 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-6c1e29e6-3d6d-4eb5-b14f-55f3da845078 req-f657a91e-a9f6-42e6-a78f-8f69252f4957 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-6c1e29e6-3d6d-4eb5-b14f-55f3da845078 req-f657a91e-a9f6-42e6-a78f-8f69252f4957 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:10 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-6c1e29e6-3d6d-4eb5-b14f-55f3da845078 req-f657a91e-a9f6-42e6-a78f-8f69252f4957 service nova] Creating event network-vif-plugged:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:17:10 user devstack@n-api.service[61933]: DEBUG nova.compute.api [req-6c1e29e6-3d6d-4eb5-b14f-55f3da845078 req-f657a91e-a9f6-42e6-a78f-8f69252f4957 service nova] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61933) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 17:17:10 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-6c1e29e6-3d6d-4eb5-b14f-55f3da845078 req-f657a91e-a9f6-42e6-a78f-8f69252f4957 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037278 Apr 14 17:17:10 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 210/641] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:17:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:17:13 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-806292f2-2b6b-49cc-bb2e-0e0487f86d9f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:13 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-806292f2-2b6b-49cc-bb2e-0e0487f86d9f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-806292f2-2b6b-49cc-bb2e-0e0487f86d9f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-806292f2-2b6b-49cc-bb2e-0e0487f86d9f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-806292f2-2b6b-49cc-bb2e-0e0487f86d9f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-806292f2-2b6b-49cc-bb2e-0e0487f86d9f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-806292f2-2b6b-49cc-bb2e-0e0487f86d9f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-806292f2-2b6b-49cc-bb2e-0e0487f86d9f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:13 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-806292f2-2b6b-49cc-bb2e-0e0487f86d9f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:17:13 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-806292f2-2b6b-49cc-bb2e-0e0487f86d9f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:17:13 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-806292f2-2b6b-49cc-bb2e-0e0487f86d9f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:17:13 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-806292f2-2b6b-49cc-bb2e-0e0487f86d9f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3e1f09c-567e-41d1-9c35-58b8371a1d1c" status: 200 len: 1690 microversion: 2.87 time: 0.240500 Apr 14 17:17:13 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 215/642] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:17:13 2023] GET /compute/v2.1/servers/a3e1f09c-567e-41d1-9c35-58b8371a1d1c => generated 1690 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:17:17 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=31 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:17:17 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-b79ec26c-88f2-4344-ab74-4c0cd2158111 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:17 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-b79ec26c-88f2-4344-ab74-4c0cd2158111 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:17 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:17:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b79ec26c-88f2-4344-ab74-4c0cd2158111 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b79ec26c-88f2-4344-ab74-4c0cd2158111 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b79ec26c-88f2-4344-ab74-4c0cd2158111 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b79ec26c-88f2-4344-ab74-4c0cd2158111 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b79ec26c-88f2-4344-ab74-4c0cd2158111 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b79ec26c-88f2-4344-ab74-4c0cd2158111 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:17 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-b79ec26c-88f2-4344-ab74-4c0cd2158111 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] HTTP exception thrown: Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 could not be found. Apr 14 17:17:17 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-b79ec26c-88f2-4344-ab74-4c0cd2158111 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Request method failure captured: Apr 14 17:17:17 user devstack@n-api.service[61935]: request: DELETE /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123 HTTP/1.1 Apr 14 17:17:17 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:17:17 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:17:17 user devstack@n-api.service[61935]: Connection: close Apr 14 17:17:17 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:17:17 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:17:17 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:17:17 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:17:17 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:17:17 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYdagj0aZ2kyBdzzq-t7NmLbidGwm-Gar54za1bjccG-oxwngdDH4Bd6HWH_5EU0CRnV_zUBi7bQPXgivTq06vp_eDuLma_gnNqfv0S3xyizKOYigLMhhMshls117JLG1BnXbbVwf6FBEFpZUXcGmx-Ytz5ObHxDXz3lqJiqvIWOEqg Apr 14 17:17:17 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:17:17 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:17:17 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:17:17 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:17:17 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:17:17 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:17:17 user devstack@n-api.service[61935]: X-Project-Id: 0c8f6b39515e456c9f5a1affa9f79000 Apr 14 17:17:17 user devstack@n-api.service[61935]: X-Project-Name: tempest-AttachVolumeTestJSON-917907278 Apr 14 17:17:17 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:17:17 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:17:17 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c8f6b39515e456c9f5a1affa9f79000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c8f6b39515e456c9f5a1affa9f79000"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c8f6b39515e456c9f5a1affa9f79000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:17:17 user devstack@n-api.service[61935]: X-Tenant: tempest-AttachVolumeTestJSON-917907278 Apr 14 17:17:17 user devstack@n-api.service[61935]: X-Tenant-Id: 0c8f6b39515e456c9f5a1affa9f79000 Apr 14 17:17:17 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-AttachVolumeTestJSON-917907278 Apr 14 17:17:17 user devstack@n-api.service[61935]: X-User: tempest-AttachVolumeTestJSON-917907278-project-member Apr 14 17:17:17 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:17:17 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:17:17 user devstack@n-api.service[61935]: X-User-Id: d7c4734925f645248b0f9060aa78a502 Apr 14 17:17:17 user devstack@n-api.service[61935]: X-User-Name: tempest-AttachVolumeTestJSON-917907278-project-member Apr 14 17:17:17 user devstack@n-api.service[61935]: method: > Apr 14 17:17:17 user devstack@n-api.service[61935]: exception: Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 could not be found. Apr 14 17:17:17 user devstack@n-api.service[61935]: action_args: {'id': '0d06e72a-65dd-433d-bc13-6550fb85a123'} Apr 14 17:17:17 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 could not be found. Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 could not be found. Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 could not be found. Apr 14 17:17:17 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:17 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-b79ec26c-88f2-4344-ab74-4c0cd2158111 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Returning 404 to user: Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:17:17 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-b79ec26c-88f2-4344-ab74-4c0cd2158111 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123" status: 404 len: 111 microversion: 2.1 time: 0.047367 Apr 14 17:17:17 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 218/643] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:17:17 2023] DELETE /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:17:17 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d850b16a-f6ab-435b-8468-8ff656ae35ee tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:17 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-d850b16a-f6ab-435b-8468-8ff656ae35ee tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: 0d06e72a-65dd-433d-bc13-6550fb85a123] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d850b16a-f6ab-435b-8468-8ff656ae35ee tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d850b16a-f6ab-435b-8468-8ff656ae35ee tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d850b16a-f6ab-435b-8468-8ff656ae35ee tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d850b16a-f6ab-435b-8468-8ff656ae35ee tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d850b16a-f6ab-435b-8468-8ff656ae35ee tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d850b16a-f6ab-435b-8468-8ff656ae35ee tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:17 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-d850b16a-f6ab-435b-8468-8ff656ae35ee tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] HTTP exception thrown: Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 could not be found. Apr 14 17:17:17 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d850b16a-f6ab-435b-8468-8ff656ae35ee tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Request method failure captured: Apr 14 17:17:17 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123 HTTP/1.1 Apr 14 17:17:17 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:17:17 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:17:17 user devstack@n-api.service[61933]: Connection: close Apr 14 17:17:17 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:17:17 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:17:17 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:17:17 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:17:17 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:17:17 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYdagj0aZ2kyBdzzq-t7NmLbidGwm-Gar54za1bjccG-oxwngdDH4Bd6HWH_5EU0CRnV_zUBi7bQPXgivTq06vp_eDuLma_gnNqfv0S3xyizKOYigLMhhMshls117JLG1BnXbbVwf6FBEFpZUXcGmx-Ytz5ObHxDXz3lqJiqvIWOEqg Apr 14 17:17:17 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:17:17 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:17:17 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:17:17 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:17:17 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:17:17 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:17:17 user devstack@n-api.service[61933]: X-Project-Id: 0c8f6b39515e456c9f5a1affa9f79000 Apr 14 17:17:17 user devstack@n-api.service[61933]: X-Project-Name: tempest-AttachVolumeTestJSON-917907278 Apr 14 17:17:17 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:17:17 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:17:17 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c8f6b39515e456c9f5a1affa9f79000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c8f6b39515e456c9f5a1affa9f79000"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c8f6b39515e456c9f5a1affa9f79000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:17:17 user devstack@n-api.service[61933]: X-Tenant: tempest-AttachVolumeTestJSON-917907278 Apr 14 17:17:17 user devstack@n-api.service[61933]: X-Tenant-Id: 0c8f6b39515e456c9f5a1affa9f79000 Apr 14 17:17:17 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-AttachVolumeTestJSON-917907278 Apr 14 17:17:17 user devstack@n-api.service[61933]: X-User: tempest-AttachVolumeTestJSON-917907278-project-member Apr 14 17:17:17 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:17:17 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:17:17 user devstack@n-api.service[61933]: X-User-Id: d7c4734925f645248b0f9060aa78a502 Apr 14 17:17:17 user devstack@n-api.service[61933]: X-User-Name: tempest-AttachVolumeTestJSON-917907278-project-member Apr 14 17:17:17 user devstack@n-api.service[61933]: method: > Apr 14 17:17:17 user devstack@n-api.service[61933]: exception: Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 could not be found. Apr 14 17:17:17 user devstack@n-api.service[61933]: action_args: {'id': '0d06e72a-65dd-433d-bc13-6550fb85a123'} Apr 14 17:17:17 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 could not be found. Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 could not be found. Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 could not be found. Apr 14 17:17:17 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:17 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d850b16a-f6ab-435b-8468-8ff656ae35ee tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Returning 404 to user: Instance 0d06e72a-65dd-433d-bc13-6550fb85a123 could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:17:17 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d850b16a-f6ab-435b-8468-8ff656ae35ee tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123" status: 404 len: 111 microversion: 2.1 time: 0.031410 Apr 14 17:17:17 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 211/644] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:17:17 2023] GET /compute/v2.1/servers/0d06e72a-65dd-433d-bc13-6550fb85a123 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:17:20 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-8c8d8a8a-1c9b-46d0-bdfd-b52c23318deb req-4a10a39f-bb0d-4831-960a-4f3f05462195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "name": "network-vif-plugged", "status": "completed", "tag": "de268504-352a-4d08-8113-a2098b794478"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:17:20 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=3 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:17:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8c8d8a8a-1c9b-46d0-bdfd-b52c23318deb req-4a10a39f-bb0d-4831-960a-4f3f05462195 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8c8d8a8a-1c9b-46d0-bdfd-b52c23318deb req-4a10a39f-bb0d-4831-960a-4f3f05462195 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8c8d8a8a-1c9b-46d0-bdfd-b52c23318deb req-4a10a39f-bb0d-4831-960a-4f3f05462195 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:20 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-8c8d8a8a-1c9b-46d0-bdfd-b52c23318deb req-4a10a39f-bb0d-4831-960a-4f3f05462195 service nova] Creating event network-vif-plugged:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:17:20 user devstack@n-api.service[61934]: DEBUG nova.compute.api [req-8c8d8a8a-1c9b-46d0-bdfd-b52c23318deb req-4a10a39f-bb0d-4831-960a-4f3f05462195 service nova] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61934) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 17:17:20 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-8c8d8a8a-1c9b-46d0-bdfd-b52c23318deb req-4a10a39f-bb0d-4831-960a-4f3f05462195 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083391 Apr 14 17:17:20 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 216/645] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:17:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:17:21 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-15e8c419-6f79-441b-8a1e-daab0e9ecaaa tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:21 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-15e8c419-6f79-441b-8a1e-daab0e9ecaaa tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-15e8c419-6f79-441b-8a1e-daab0e9ecaaa tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-15e8c419-6f79-441b-8a1e-daab0e9ecaaa tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-15e8c419-6f79-441b-8a1e-daab0e9ecaaa tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-15e8c419-6f79-441b-8a1e-daab0e9ecaaa tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-15e8c419-6f79-441b-8a1e-daab0e9ecaaa tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-15e8c419-6f79-441b-8a1e-daab0e9ecaaa tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:21 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-15e8c419-6f79-441b-8a1e-daab0e9ecaaa tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] HTTP exception thrown: Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 could not be found. Apr 14 17:17:21 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-15e8c419-6f79-441b-8a1e-daab0e9ecaaa tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Request method failure captured: Apr 14 17:17:21 user devstack@n-api.service[61935]: request: DELETE /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97 HTTP/1.1 Apr 14 17:17:21 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:17:21 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:17:21 user devstack@n-api.service[61935]: Connection: close Apr 14 17:17:21 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:17:21 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:17:21 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:17:21 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:17:21 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:17:21 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYdagj0aZ2kyBdzzq-t7NmLbidGwm-Gar54za1bjccG-oxwngdDH4Bd6HWH_5EU0CRnV_zUBi7bQPXgivTq06vp_eDuLma_gnNqfv0S3xyizKOYigLMhhMshls117JLG1BnXbbVwf6FBEFpZUXcGmx-Ytz5ObHxDXz3lqJiqvIWOEqg Apr 14 17:17:21 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:17:21 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:17:21 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:17:21 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:17:21 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:17:21 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:17:21 user devstack@n-api.service[61935]: X-Project-Id: 0c8f6b39515e456c9f5a1affa9f79000 Apr 14 17:17:21 user devstack@n-api.service[61935]: X-Project-Name: tempest-AttachVolumeTestJSON-917907278 Apr 14 17:17:21 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:17:21 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:17:21 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c8f6b39515e456c9f5a1affa9f79000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c8f6b39515e456c9f5a1affa9f79000"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c8f6b39515e456c9f5a1affa9f79000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:17:21 user devstack@n-api.service[61935]: X-Tenant: tempest-AttachVolumeTestJSON-917907278 Apr 14 17:17:21 user devstack@n-api.service[61935]: X-Tenant-Id: 0c8f6b39515e456c9f5a1affa9f79000 Apr 14 17:17:21 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-AttachVolumeTestJSON-917907278 Apr 14 17:17:21 user devstack@n-api.service[61935]: X-User: tempest-AttachVolumeTestJSON-917907278-project-member Apr 14 17:17:21 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:17:21 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:17:21 user devstack@n-api.service[61935]: X-User-Id: d7c4734925f645248b0f9060aa78a502 Apr 14 17:17:21 user devstack@n-api.service[61935]: X-User-Name: tempest-AttachVolumeTestJSON-917907278-project-member Apr 14 17:17:21 user devstack@n-api.service[61935]: method: > Apr 14 17:17:21 user devstack@n-api.service[61935]: exception: Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 could not be found. Apr 14 17:17:21 user devstack@n-api.service[61935]: action_args: {'id': 'd68b702a-a0dc-4030-9893-87b4ef44fb97'} Apr 14 17:17:21 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 could not be found. Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 could not be found. Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 could not be found. Apr 14 17:17:21 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:21 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-15e8c419-6f79-441b-8a1e-daab0e9ecaaa tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Returning 404 to user: Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:17:21 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-15e8c419-6f79-441b-8a1e-daab0e9ecaaa tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97" status: 404 len: 111 microversion: 2.1 time: 0.027291 Apr 14 17:17:21 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 219/646] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:17:21 2023] DELETE /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:17:21 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-2a3a170e-7c05-4db6-82f0-b127367a40a8 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:21 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-2a3a170e-7c05-4db6-82f0-b127367a40a8 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] [instance: d68b702a-a0dc-4030-9893-87b4ef44fb97] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2a3a170e-7c05-4db6-82f0-b127367a40a8 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2a3a170e-7c05-4db6-82f0-b127367a40a8 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2a3a170e-7c05-4db6-82f0-b127367a40a8 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2a3a170e-7c05-4db6-82f0-b127367a40a8 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2a3a170e-7c05-4db6-82f0-b127367a40a8 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:21 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2a3a170e-7c05-4db6-82f0-b127367a40a8 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:21 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-2a3a170e-7c05-4db6-82f0-b127367a40a8 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] HTTP exception thrown: Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 could not be found. Apr 14 17:17:21 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-2a3a170e-7c05-4db6-82f0-b127367a40a8 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Request method failure captured: Apr 14 17:17:21 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97 HTTP/1.1 Apr 14 17:17:21 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:17:21 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:17:21 user devstack@n-api.service[61933]: Connection: close Apr 14 17:17:21 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:17:21 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:17:21 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:17:21 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:17:21 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:17:21 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYdagj0aZ2kyBdzzq-t7NmLbidGwm-Gar54za1bjccG-oxwngdDH4Bd6HWH_5EU0CRnV_zUBi7bQPXgivTq06vp_eDuLma_gnNqfv0S3xyizKOYigLMhhMshls117JLG1BnXbbVwf6FBEFpZUXcGmx-Ytz5ObHxDXz3lqJiqvIWOEqg Apr 14 17:17:21 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:17:21 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:17:21 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:17:21 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:17:21 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:17:21 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:17:21 user devstack@n-api.service[61933]: X-Project-Id: 0c8f6b39515e456c9f5a1affa9f79000 Apr 14 17:17:21 user devstack@n-api.service[61933]: X-Project-Name: tempest-AttachVolumeTestJSON-917907278 Apr 14 17:17:21 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:17:21 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:17:21 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c8f6b39515e456c9f5a1affa9f79000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c8f6b39515e456c9f5a1affa9f79000"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c8f6b39515e456c9f5a1affa9f79000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:17:21 user devstack@n-api.service[61933]: X-Tenant: tempest-AttachVolumeTestJSON-917907278 Apr 14 17:17:21 user devstack@n-api.service[61933]: X-Tenant-Id: 0c8f6b39515e456c9f5a1affa9f79000 Apr 14 17:17:21 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-AttachVolumeTestJSON-917907278 Apr 14 17:17:21 user devstack@n-api.service[61933]: X-User: tempest-AttachVolumeTestJSON-917907278-project-member Apr 14 17:17:21 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:17:21 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:17:21 user devstack@n-api.service[61933]: X-User-Id: d7c4734925f645248b0f9060aa78a502 Apr 14 17:17:21 user devstack@n-api.service[61933]: X-User-Name: tempest-AttachVolumeTestJSON-917907278-project-member Apr 14 17:17:21 user devstack@n-api.service[61933]: method: > Apr 14 17:17:21 user devstack@n-api.service[61933]: exception: Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 could not be found. Apr 14 17:17:21 user devstack@n-api.service[61933]: action_args: {'id': 'd68b702a-a0dc-4030-9893-87b4ef44fb97'} Apr 14 17:17:21 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 could not be found. Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 could not be found. Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 could not be found. Apr 14 17:17:21 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:21 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-2a3a170e-7c05-4db6-82f0-b127367a40a8 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] Returning 404 to user: Instance d68b702a-a0dc-4030-9893-87b4ef44fb97 could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:17:21 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-2a3a170e-7c05-4db6-82f0-b127367a40a8 tempest-AttachVolumeTestJSON-917907278 tempest-AttachVolumeTestJSON-917907278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97" status: 404 len: 111 microversion: 2.1 time: 0.041773 Apr 14 17:17:21 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 212/647] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:17:21 2023] GET /compute/v2.1/servers/d68b702a-a0dc-4030-9893-87b4ef44fb97 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:17:22 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-2e8ccfa7-a13d-42f1-8303-1bbbdac3cf59 req-c34184ae-e240-44c7-a151-aa16c9035ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "name": "network-vif-plugged", "status": "completed", "tag": "de268504-352a-4d08-8113-a2098b794478"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:17:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-2e8ccfa7-a13d-42f1-8303-1bbbdac3cf59 req-c34184ae-e240-44c7-a151-aa16c9035ed8 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-2e8ccfa7-a13d-42f1-8303-1bbbdac3cf59 req-c34184ae-e240-44c7-a151-aa16c9035ed8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-2e8ccfa7-a13d-42f1-8303-1bbbdac3cf59 req-c34184ae-e240-44c7-a151-aa16c9035ed8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:22 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-2e8ccfa7-a13d-42f1-8303-1bbbdac3cf59 req-c34184ae-e240-44c7-a151-aa16c9035ed8 service nova] Creating event network-vif-plugged:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:17:22 user devstack@n-api.service[61934]: DEBUG nova.compute.api [req-2e8ccfa7-a13d-42f1-8303-1bbbdac3cf59 req-c34184ae-e240-44c7-a151-aa16c9035ed8 service nova] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61934) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 17:17:22 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-2e8ccfa7-a13d-42f1-8303-1bbbdac3cf59 req-c34184ae-e240-44c7-a151-aa16c9035ed8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061217 Apr 14 17:17:22 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 217/648] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:17:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:17:22 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-8880ceea-20ae-4954-871a-2f0a46c64c9e tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:22 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-8880ceea-20ae-4954-871a-2f0a46c64c9e tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8880ceea-20ae-4954-871a-2f0a46c64c9e tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8880ceea-20ae-4954-871a-2f0a46c64c9e tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8880ceea-20ae-4954-871a-2f0a46c64c9e tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8880ceea-20ae-4954-871a-2f0a46c64c9e tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8880ceea-20ae-4954-871a-2f0a46c64c9e tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8880ceea-20ae-4954-871a-2f0a46c64c9e tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:22 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-8880ceea-20ae-4954-871a-2f0a46c64c9e tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8312ebadc8bf438dbc01dc42c6257a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ed93a0cc2a4b2689cd9d26b7f73a14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:17:23 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-8880ceea-20ae-4954-871a-2f0a46c64c9e tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5dd90e8-4232-4f87-ac96-a5a142e3370c" status: 200 len: 1485 microversion: 2.1 time: 0.243336 Apr 14 17:17:23 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 220/649] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:17:22 2023] GET /compute/v2.1/servers/d5dd90e8-4232-4f87-ac96-a5a142e3370c => generated 1485 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:17:23 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-478d544a-b2d0-4faa-ac51-e0e6d1fdf830 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35e1a533-35dd-4783-afc1-937803c5e0cb"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:17:23 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-478d544a-b2d0-4faa-ac51-e0e6d1fdf830 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-478d544a-b2d0-4faa-ac51-e0e6d1fdf830 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-478d544a-b2d0-4faa-ac51-e0e6d1fdf830 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-478d544a-b2d0-4faa-ac51-e0e6d1fdf830 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-478d544a-b2d0-4faa-ac51-e0e6d1fdf830 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-478d544a-b2d0-4faa-ac51-e0e6d1fdf830 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-478d544a-b2d0-4faa-ac51-e0e6d1fdf830 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:23 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-478d544a-b2d0-4faa-ac51-e0e6d1fdf830 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] HTTP exception thrown: Cannot 'attach_volume' instance a075e35f-c43c-4e3a-adb2-2e1629079d93 while it is in vm_state rescued Apr 14 17:17:23 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-478d544a-b2d0-4faa-ac51-e0e6d1fdf830 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Request method failure captured: Apr 14 17:17:23 user devstack@n-api.service[61933]: request: POST /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93/os-volume_attachments HTTP/1.1 Apr 14 17:17:23 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:17:23 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:17:23 user devstack@n-api.service[61933]: Connection: close Apr 14 17:17:23 user devstack@n-api.service[61933]: Content-Length: 74 Apr 14 17:17:23 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:17:23 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:17:23 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:17:23 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:17:23 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYkVBClkxIawkM1nyUWU7TVOYrVEr-N9nAU0PhEuzEE_-YQvgNuTftESHpChD4G1-5d4DpIA7CkgTQ_FGsRsbu8wQIBOC8wC2te9X-DHMsSVpuMD-5ffx2BY9NFTVd25q-U7totKdOrSDVAhHx_Uazr6ZqvpJMFsWKYTM7zuiuFUAR8 Apr 14 17:17:23 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:17:23 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:17:23 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:17:23 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:17:23 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:17:23 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:17:23 user devstack@n-api.service[61933]: X-Project-Id: 070c6b9f620548b183904d1971f35752 Apr 14 17:17:23 user devstack@n-api.service[61933]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2056337871 Apr 14 17:17:23 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:17:23 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:17:23 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/070c6b9f620548b183904d1971f35752"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/070c6b9f620548b183904d1971f35752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/070c6b9f620548b183904d1971f35752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:17:23 user devstack@n-api.service[61933]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2056337871 Apr 14 17:17:23 user devstack@n-api.service[61933]: X-Tenant-Id: 070c6b9f620548b183904d1971f35752 Apr 14 17:17:23 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2056337871 Apr 14 17:17:23 user devstack@n-api.service[61933]: X-User: tempest-ServerRescueNegativeTestJSON-2056337871-project-member Apr 14 17:17:23 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:17:23 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:17:23 user devstack@n-api.service[61933]: X-User-Id: 2434278fe61447fab1f5a930aa16a1de Apr 14 17:17:23 user devstack@n-api.service[61933]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2056337871-project-member Apr 14 17:17:23 user devstack@n-api.service[61933]: Apr 14 17:17:23 user devstack@n-api.service[61933]: {"volumeAttachment": {"volumeId": "35e1a533-35dd-4783-afc1-937803c5e0cb"}} Apr 14 17:17:23 user devstack@n-api.service[61933]: method: > Apr 14 17:17:23 user devstack@n-api.service[61933]: exception: Cannot 'attach_volume' instance a075e35f-c43c-4e3a-adb2-2e1629079d93 while it is in vm_state rescued Apr 14 17:17:23 user devstack@n-api.service[61933]: action_args: {'server_id': 'a075e35f-c43c-4e3a-adb2-2e1629079d93', 'body': {'volumeAttachment': {'volumeId': '35e1a533-35dd-4783-afc1-937803c5e0cb'}}} Apr 14 17:17:23 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a075e35f-c43c-4e3a-adb2-2e1629079d93 while it is in vm_state rescued Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a075e35f-c43c-4e3a-adb2-2e1629079d93 while it is in vm_state rescued Apr 14 17:17:23 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:23 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-478d544a-b2d0-4faa-ac51-e0e6d1fdf830 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Returning 409 to user: Cannot 'attach_volume' instance a075e35f-c43c-4e3a-adb2-2e1629079d93 while it is in vm_state rescued {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:17:23 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-478d544a-b2d0-4faa-ac51-e0e6d1fdf830 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061421 Apr 14 17:17:23 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 213/650] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:17:23 2023] POST /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93/os-volume_attachments => generated 152 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 17:17:23 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-d8f7ff66-c85a-4a63-87e0-0162e84a1001 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:17:23 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-d8f7ff66-c85a-4a63-87e0-0162e84a1001 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d8f7ff66-c85a-4a63-87e0-0162e84a1001 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d8f7ff66-c85a-4a63-87e0-0162e84a1001 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d8f7ff66-c85a-4a63-87e0-0162e84a1001 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d8f7ff66-c85a-4a63-87e0-0162e84a1001 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d8f7ff66-c85a-4a63-87e0-0162e84a1001 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d8f7ff66-c85a-4a63-87e0-0162e84a1001 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:23 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-d8f7ff66-c85a-4a63-87e0-0162e84a1001 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93/action" status: 202 len: 0 microversion: 2.1 time: 0.478916 Apr 14 17:17:23 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 218/651] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:17:23 2023] POST /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:17:23 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-24e70fea-3719-4582-9d59-729d31bf127b tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:23 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-24e70fea-3719-4582-9d59-729d31bf127b tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-24e70fea-3719-4582-9d59-729d31bf127b tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-24e70fea-3719-4582-9d59-729d31bf127b tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-24e70fea-3719-4582-9d59-729d31bf127b tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-24e70fea-3719-4582-9d59-729d31bf127b tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-24e70fea-3719-4582-9d59-729d31bf127b tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-24e70fea-3719-4582-9d59-729d31bf127b tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:23 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-24e70fea-3719-4582-9d59-729d31bf127b tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:17:23 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-24e70fea-3719-4582-9d59-729d31bf127b tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93" status: 200 len: 1497 microversion: 2.1 time: 0.235977 Apr 14 17:17:23 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 221/652] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:17:23 2023] GET /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93 => generated 1497 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:17:24 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-dd4d2bd6-8151-4e7a-93f5-6d386c00cc2d req-3f81be8f-0a74-4c9e-9a03-1ecc0580d57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a075e35f-c43c-4e3a-adb2-2e1629079d93", "name": "network-vif-unplugged", "status": "completed", "tag": "1477a3d2-85fc-4f05-83a0-156f88fc4939"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:17:24 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-dd4d2bd6-8151-4e7a-93f5-6d386c00cc2d req-3f81be8f-0a74-4c9e-9a03-1ecc0580d57e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:24 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-dd4d2bd6-8151-4e7a-93f5-6d386c00cc2d req-3f81be8f-0a74-4c9e-9a03-1ecc0580d57e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:24 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-dd4d2bd6-8151-4e7a-93f5-6d386c00cc2d req-3f81be8f-0a74-4c9e-9a03-1ecc0580d57e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:24 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-dd4d2bd6-8151-4e7a-93f5-6d386c00cc2d req-3f81be8f-0a74-4c9e-9a03-1ecc0580d57e service nova] Creating event network-vif-unplugged:1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance a075e35f-c43c-4e3a-adb2-2e1629079d93 on user Apr 14 17:17:24 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-dd4d2bd6-8151-4e7a-93f5-6d386c00cc2d req-3f81be8f-0a74-4c9e-9a03-1ecc0580d57e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038722 Apr 14 17:17:24 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 214/653] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:17:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:17:26 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-39f03a33-c8dd-4700-ba53-1380199405c7 req-648cdf1a-7697-43f1-a23d-47fa7221e514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a075e35f-c43c-4e3a-adb2-2e1629079d93", "name": "network-vif-plugged", "status": "completed", "tag": "1477a3d2-85fc-4f05-83a0-156f88fc4939"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:17:26 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-39f03a33-c8dd-4700-ba53-1380199405c7 req-648cdf1a-7697-43f1-a23d-47fa7221e514 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:26 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-39f03a33-c8dd-4700-ba53-1380199405c7 req-648cdf1a-7697-43f1-a23d-47fa7221e514 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:26 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-39f03a33-c8dd-4700-ba53-1380199405c7 req-648cdf1a-7697-43f1-a23d-47fa7221e514 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:26 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-39f03a33-c8dd-4700-ba53-1380199405c7 req-648cdf1a-7697-43f1-a23d-47fa7221e514 service nova] Creating event network-vif-plugged:1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance a075e35f-c43c-4e3a-adb2-2e1629079d93 on user Apr 14 17:17:26 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-39f03a33-c8dd-4700-ba53-1380199405c7 req-648cdf1a-7697-43f1-a23d-47fa7221e514 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033015 Apr 14 17:17:26 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 219/654] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:17:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:17:28 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a075e35f-c43c-4e3a-adb2-2e1629079d93", "name": "network-vif-plugged", "status": "completed", "tag": "1477a3d2-85fc-4f05-83a0-156f88fc4939"}, {"server_uuid": "a075e35f-c43c-4e3a-adb2-2e1629079d93", "name": "network-vif-plugged", "status": "completed", "tag": "1477a3d2-85fc-4f05-83a0-156f88fc4939"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:17:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:29 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] Creating event network-vif-plugged:1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance a075e35f-c43c-4e3a-adb2-2e1629079d93 on user Apr 14 17:17:29 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] Creating event network-vif-plugged:1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance a075e35f-c43c-4e3a-adb2-2e1629079d93 on user Apr 14 17:17:29 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-4947fdad-53f3-4710-924e-73b080ee04c1 req-5d6ab0f0-128f-4ac2-b816-27e5ce7fe38f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030632 Apr 14 17:17:29 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 222/655] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:17:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:17:39 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=12 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:17:39 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=18 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:17:39 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-5e5069fb-107c-4906-a173-988d8b35f2ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:39 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-5e5069fb-107c-4906-a173-988d8b35f2ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5e5069fb-107c-4906-a173-988d8b35f2ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5e5069fb-107c-4906-a173-988d8b35f2ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5e5069fb-107c-4906-a173-988d8b35f2ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5e5069fb-107c-4906-a173-988d8b35f2ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5e5069fb-107c-4906-a173-988d8b35f2ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5e5069fb-107c-4906-a173-988d8b35f2ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-5e5069fb-107c-4906-a173-988d8b35f2ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] HTTP exception thrown: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. Apr 14 17:17:39 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-5e5069fb-107c-4906-a173-988d8b35f2ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Request method failure captured: Apr 14 17:17:39 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860 HTTP/1.1 Apr 14 17:17:39 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:17:39 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:17:39 user devstack@n-api.service[61933]: Connection: close Apr 14 17:17:39 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:17:39 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:17:39 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:17:39 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:17:39 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:17:39 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYdYtBTMjEs6wq_AX7uLwl48FezTrz7FyW6CSVOm9G6i0ttgahwJf1S74Fss_9qd0JO9t5wr7pQDv25cSrw7tI0XNOdCBZPRJQlF-w0w2Xn2ZRZ5EUArK2xGuE0HglaJJpHNyoLBzYQsp9Av8_ba24psGn8qYzpzCLzlLWiMZvDXQQQ Apr 14 17:17:39 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:17:39 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:17:39 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:17:39 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:17:39 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:17:39 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:17:39 user devstack@n-api.service[61933]: X-Project-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:17:39 user devstack@n-api.service[61933]: X-Project-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:39 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:17:39 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:17:39 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6f341a2096b9483787b569a59f325556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:17:39 user devstack@n-api.service[61933]: X-Tenant: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:39 user devstack@n-api.service[61933]: X-Tenant-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:17:39 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:39 user devstack@n-api.service[61933]: X-User: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:17:39 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:17:39 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:17:39 user devstack@n-api.service[61933]: X-User-Id: d9c9e0d318eb4ca49d47d620682fb00a Apr 14 17:17:39 user devstack@n-api.service[61933]: X-User-Name: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:17:39 user devstack@n-api.service[61933]: method: > Apr 14 17:17:39 user devstack@n-api.service[61933]: exception: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. Apr 14 17:17:39 user devstack@n-api.service[61933]: action_args: {'id': 'c85ab15f-39ed-43cc-bbdf-b030dd21d860'} Apr 14 17:17:39 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. Apr 14 17:17:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:39 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-5e5069fb-107c-4906-a173-988d8b35f2ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Returning 404 to user: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:17:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-5e5069fb-107c-4906-a173-988d8b35f2ac tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860" status: 404 len: 111 microversion: 2.1 time: 0.031787 Apr 14 17:17:39 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 215/656] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:17:39 2023] GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:17:39 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=28 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:17:39 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:17:39 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-47e1ff70-4a62-4f8b-8855-790021391dbe tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '.version_select at 0x7fe19cef5750>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:39 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-47e1ff70-4a62-4f8b-8855-790021391dbe tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-154124342" status: 202 len: 0 microversion: 2.1 time: 0.037653 Apr 14 17:17:39 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 220/657] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 17:17:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-154124342 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:17:40 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=9 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:17:40 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=18 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:17:40 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-36c6259d-00a3-43cf-87e5-e93976e1765d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:40 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-36c6259d-00a3-43cf-87e5-e93976e1765d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 35dee18b-ac00-4f46-813e-7a7b400cdba5] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-36c6259d-00a3-43cf-87e5-e93976e1765d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-36c6259d-00a3-43cf-87e5-e93976e1765d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-36c6259d-00a3-43cf-87e5-e93976e1765d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-36c6259d-00a3-43cf-87e5-e93976e1765d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-36c6259d-00a3-43cf-87e5-e93976e1765d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-36c6259d-00a3-43cf-87e5-e93976e1765d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:40 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-36c6259d-00a3-43cf-87e5-e93976e1765d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] HTTP exception thrown: Instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 could not be found. Apr 14 17:17:40 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-36c6259d-00a3-43cf-87e5-e93976e1765d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Request method failure captured: Apr 14 17:17:40 user devstack@n-api.service[61935]: request: GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5 HTTP/1.1 Apr 14 17:17:40 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:17:40 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:17:40 user devstack@n-api.service[61935]: Connection: close Apr 14 17:17:40 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:17:40 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:17:40 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:17:40 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:17:40 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:17:40 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYlH8oeecSNmWpcptJ7XQIg_czFAdoxZlEn7n9bZMWzl2Cey_zb44KiBPB5hBZCJuPRxZS0tzBAMtnKhqqdQ2MYOjUj8RmHi4TQSQ-tS3z_yl5OsJr6EVti0XIm87vd_6aqqJws-eEBXEZwCnCAh-boDeWVkYEkG4ObXm2GgFk8-T-M Apr 14 17:17:40 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:17:40 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:17:40 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:17:40 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:17:40 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:17:40 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:17:40 user devstack@n-api.service[61935]: X-Project-Id: 0a92a4f922f442a88cfb86f8239e52ac Apr 14 17:17:40 user devstack@n-api.service[61935]: X-Project-Name: tempest-TestMinimumBasicScenario-1645387059 Apr 14 17:17:40 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:17:40 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:17:40 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a92a4f922f442a88cfb86f8239e52ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a92a4f922f442a88cfb86f8239e52ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0a92a4f922f442a88cfb86f8239e52ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:17:40 user devstack@n-api.service[61935]: X-Tenant: tempest-TestMinimumBasicScenario-1645387059 Apr 14 17:17:40 user devstack@n-api.service[61935]: X-Tenant-Id: 0a92a4f922f442a88cfb86f8239e52ac Apr 14 17:17:40 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1645387059 Apr 14 17:17:40 user devstack@n-api.service[61935]: X-User: tempest-TestMinimumBasicScenario-1645387059-project-member Apr 14 17:17:40 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:17:40 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:17:40 user devstack@n-api.service[61935]: X-User-Id: 4bd0842f11b0499298e2af46ad659962 Apr 14 17:17:40 user devstack@n-api.service[61935]: X-User-Name: tempest-TestMinimumBasicScenario-1645387059-project-member Apr 14 17:17:40 user devstack@n-api.service[61935]: method: > Apr 14 17:17:40 user devstack@n-api.service[61935]: exception: Instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 could not be found. Apr 14 17:17:40 user devstack@n-api.service[61935]: action_args: {'id': '35dee18b-ac00-4f46-813e-7a7b400cdba5'} Apr 14 17:17:40 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 could not be found. Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 could not be found. Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 could not be found. Apr 14 17:17:40 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:40 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-36c6259d-00a3-43cf-87e5-e93976e1765d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Returning 404 to user: Instance 35dee18b-ac00-4f46-813e-7a7b400cdba5 could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:17:40 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-36c6259d-00a3-43cf-87e5-e93976e1765d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5" status: 404 len: 111 microversion: 2.1 time: 0.055932 Apr 14 17:17:40 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 223/658] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:17:40 2023] GET /compute/v2.1/servers/35dee18b-ac00-4f46-813e-7a7b400cdba5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:17:40 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-aac17914-6c29-437b-b24e-d88716a9c38a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '.version_select at 0x7fe19cc0cdc0>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:40 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-aac17914-6c29-437b-b24e-d88716a9c38a tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-117998537" status: 202 len: 0 microversion: 2.1 time: 0.030120 Apr 14 17:17:40 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 216/659] 10.0.0.210 () {62 vars in 1346 bytes} [Fri Apr 14 17:17:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-117998537 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:17:43 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-7f1f37a6-c67e-40dd-9520-549f0b8298fb tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Action: 'create', calling method: .version_select at 0x7fe19cef56c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1307984235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBqCKExFDT4PvSC0/Uu1Any81coLdKotsFBCAghCyw66XGwNtKRqgQhOViH0z9vGTd8aHqH3bIsE+BRrOoCbXTCLZj1BZ5obFRwyyFzyqkP9hL4qq9+vfqA17m0cuNySw=="}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:17:43 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-7f1f37a6-c67e-40dd-9520-549f0b8298fb tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Getting quotas for project 0a92a4f922f442a88cfb86f8239e52ac. Resources: {'key_pairs'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:17:43 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-7f1f37a6-c67e-40dd-9520-549f0b8298fb tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Getting quotas for user 4bd0842f11b0499298e2af46ad659962 and project 0a92a4f922f442a88cfb86f8239e52ac. Resources: {'key_pairs'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:17:43 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-7f1f37a6-c67e-40dd-9520-549f0b8298fb tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058680 Apr 14 17:17:43 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 221/660] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 17:17:43 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:17:43 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-061084b2-92ec-4a96-bcdc-34cb682db683 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:43 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-061084b2-92ec-4a96-bcdc-34cb682db683 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:43 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-061084b2-92ec-4a96-bcdc-34cb682db683 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:43 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-061084b2-92ec-4a96-bcdc-34cb682db683 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:43 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-061084b2-92ec-4a96-bcdc-34cb682db683 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:43 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-061084b2-92ec-4a96-bcdc-34cb682db683 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:43 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-061084b2-92ec-4a96-bcdc-34cb682db683 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:43 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-061084b2-92ec-4a96-bcdc-34cb682db683 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:43 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-061084b2-92ec-4a96-bcdc-34cb682db683 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] HTTP exception thrown: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. Apr 14 17:17:43 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-061084b2-92ec-4a96-bcdc-34cb682db683 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Request method failure captured: Apr 14 17:17:43 user devstack@n-api.service[61935]: request: DELETE /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860 HTTP/1.1 Apr 14 17:17:43 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:17:43 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:17:43 user devstack@n-api.service[61935]: Connection: close Apr 14 17:17:43 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:17:43 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:17:43 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:17:43 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:17:43 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:17:43 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYdYtBTMjEs6wq_AX7uLwl48FezTrz7FyW6CSVOm9G6i0ttgahwJf1S74Fss_9qd0JO9t5wr7pQDv25cSrw7tI0XNOdCBZPRJQlF-w0w2Xn2ZRZ5EUArK2xGuE0HglaJJpHNyoLBzYQsp9Av8_ba24psGn8qYzpzCLzlLWiMZvDXQQQ Apr 14 17:17:43 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:17:43 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:17:43 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:17:43 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:17:43 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:17:43 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:17:43 user devstack@n-api.service[61935]: X-Project-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:17:43 user devstack@n-api.service[61935]: X-Project-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:43 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:17:43 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:17:43 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6f341a2096b9483787b569a59f325556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:17:43 user devstack@n-api.service[61935]: X-Tenant: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:43 user devstack@n-api.service[61935]: X-Tenant-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:17:43 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:43 user devstack@n-api.service[61935]: X-User: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:17:43 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:17:43 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:17:43 user devstack@n-api.service[61935]: X-User-Id: d9c9e0d318eb4ca49d47d620682fb00a Apr 14 17:17:43 user devstack@n-api.service[61935]: X-User-Name: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:17:43 user devstack@n-api.service[61935]: method: > Apr 14 17:17:43 user devstack@n-api.service[61935]: exception: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. Apr 14 17:17:43 user devstack@n-api.service[61935]: action_args: {'id': 'c85ab15f-39ed-43cc-bbdf-b030dd21d860'} Apr 14 17:17:43 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. Apr 14 17:17:43 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:43 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-061084b2-92ec-4a96-bcdc-34cb682db683 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Returning 404 to user: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:17:43 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-061084b2-92ec-4a96-bcdc-34cb682db683 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860" status: 404 len: 111 microversion: 2.1 time: 0.036061 Apr 14 17:17:43 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 224/661] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:17:43 2023] DELETE /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:17:43 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-e2919d73-e1b2-4346-b671-5df8d1f87bc9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:43 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-e2919d73-e1b2-4346-b671-5df8d1f87bc9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c85ab15f-39ed-43cc-bbdf-b030dd21d860] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e2919d73-e1b2-4346-b671-5df8d1f87bc9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e2919d73-e1b2-4346-b671-5df8d1f87bc9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e2919d73-e1b2-4346-b671-5df8d1f87bc9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e2919d73-e1b2-4346-b671-5df8d1f87bc9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e2919d73-e1b2-4346-b671-5df8d1f87bc9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e2919d73-e1b2-4346-b671-5df8d1f87bc9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:43 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-e2919d73-e1b2-4346-b671-5df8d1f87bc9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] HTTP exception thrown: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. Apr 14 17:17:43 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-e2919d73-e1b2-4346-b671-5df8d1f87bc9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Request method failure captured: Apr 14 17:17:43 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860 HTTP/1.1 Apr 14 17:17:43 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:17:43 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:17:43 user devstack@n-api.service[61933]: Connection: close Apr 14 17:17:43 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:17:43 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:17:43 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:17:43 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:17:43 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:17:43 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYdYtBTMjEs6wq_AX7uLwl48FezTrz7FyW6CSVOm9G6i0ttgahwJf1S74Fss_9qd0JO9t5wr7pQDv25cSrw7tI0XNOdCBZPRJQlF-w0w2Xn2ZRZ5EUArK2xGuE0HglaJJpHNyoLBzYQsp9Av8_ba24psGn8qYzpzCLzlLWiMZvDXQQQ Apr 14 17:17:43 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:17:43 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:17:43 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:17:43 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:17:43 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:17:43 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:17:43 user devstack@n-api.service[61933]: X-Project-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:17:43 user devstack@n-api.service[61933]: X-Project-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:43 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:17:43 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:17:43 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6f341a2096b9483787b569a59f325556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:17:43 user devstack@n-api.service[61933]: X-Tenant: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:43 user devstack@n-api.service[61933]: X-Tenant-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:17:43 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:43 user devstack@n-api.service[61933]: X-User: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:17:43 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:17:43 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:17:43 user devstack@n-api.service[61933]: X-User-Id: d9c9e0d318eb4ca49d47d620682fb00a Apr 14 17:17:43 user devstack@n-api.service[61933]: X-User-Name: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:17:43 user devstack@n-api.service[61933]: method: > Apr 14 17:17:43 user devstack@n-api.service[61933]: exception: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. Apr 14 17:17:43 user devstack@n-api.service[61933]: action_args: {'id': 'c85ab15f-39ed-43cc-bbdf-b030dd21d860'} Apr 14 17:17:43 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. Apr 14 17:17:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:43 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-e2919d73-e1b2-4346-b671-5df8d1f87bc9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Returning 404 to user: Instance c85ab15f-39ed-43cc-bbdf-b030dd21d860 could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:17:43 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-e2919d73-e1b2-4346-b671-5df8d1f87bc9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860" status: 404 len: 111 microversion: 2.1 time: 0.035783 Apr 14 17:17:43 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 217/662] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:17:43 2023] GET /compute/v2.1/servers/c85ab15f-39ed-43cc-bbdf-b030dd21d860 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:17:43 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1126441201", "imageRef": "8caa5797-8d3f-4f61-87c7-49659946e637", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1307984235", "networks": [{"uuid": "c5734dfe-c265-4d08-840a-4116e7574b53"}]}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:17:43 user devstack@n-api.service[61934]: DEBUG nova.network.neutron [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] validate_networks() for [('c5734dfe-c265-4d08-840a-4116e7574b53', None, None, None, None, None)] {{(pid=61934) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:17:44 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:17:44 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:17:44 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:17:44 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:17:44 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:17:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:44 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Getting quotas for project 0a92a4f922f442a88cfb86f8239e52ac. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:17:44 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Getting quotas for user 4bd0842f11b0499298e2af46ad659962 and project 0a92a4f922f442a88cfb86f8239e52ac. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:17:44 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Going to run 1 instances... {{(pid=61934) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:17:44 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8caa5797-8d3f-4f61-87c7-49659946e637',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:17:44 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-222597aa-71db-406e-ae12-f32ee9e49bc4 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.750969 Apr 14 17:17:44 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 222/663] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:17:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:17:44 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-758759aa-4198-409e-b224-e944d8243392 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:44 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-758759aa-4198-409e-b224-e944d8243392 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:44 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-758759aa-4198-409e-b224-e944d8243392 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:17:44 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-758759aa-4198-409e-b224-e944d8243392 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" status: 200 len: 1253 microversion: 2.1 time: 0.084605 Apr 14 17:17:44 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 225/664] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:17:44 2023] GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 => generated 1253 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:17:46 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-122315ad-94d2-41c1-8c7c-95cfb587656f tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:46 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-122315ad-94d2-41c1-8c7c-95cfb587656f tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-122315ad-94d2-41c1-8c7c-95cfb587656f tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-122315ad-94d2-41c1-8c7c-95cfb587656f tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-122315ad-94d2-41c1-8c7c-95cfb587656f tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-122315ad-94d2-41c1-8c7c-95cfb587656f tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-122315ad-94d2-41c1-8c7c-95cfb587656f tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-122315ad-94d2-41c1-8c7c-95cfb587656f tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-122315ad-94d2-41c1-8c7c-95cfb587656f tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] HTTP exception thrown: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. Apr 14 17:17:46 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-122315ad-94d2-41c1-8c7c-95cfb587656f tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Request method failure captured: Apr 14 17:17:46 user devstack@n-api.service[61933]: request: DELETE /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac HTTP/1.1 Apr 14 17:17:46 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:17:46 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:17:46 user devstack@n-api.service[61933]: Connection: close Apr 14 17:17:46 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:17:46 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:17:46 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:17:46 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:17:46 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:17:46 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYdYtBTMjEs6wq_AX7uLwl48FezTrz7FyW6CSVOm9G6i0ttgahwJf1S74Fss_9qd0JO9t5wr7pQDv25cSrw7tI0XNOdCBZPRJQlF-w0w2Xn2ZRZ5EUArK2xGuE0HglaJJpHNyoLBzYQsp9Av8_ba24psGn8qYzpzCLzlLWiMZvDXQQQ Apr 14 17:17:46 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:17:46 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:17:46 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:17:46 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:17:46 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:17:46 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:17:46 user devstack@n-api.service[61933]: X-Project-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:17:46 user devstack@n-api.service[61933]: X-Project-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:46 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:17:46 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:17:46 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6f341a2096b9483787b569a59f325556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:17:46 user devstack@n-api.service[61933]: X-Tenant: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:46 user devstack@n-api.service[61933]: X-Tenant-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:17:46 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:46 user devstack@n-api.service[61933]: X-User: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:17:46 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:17:46 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:17:46 user devstack@n-api.service[61933]: X-User-Id: d9c9e0d318eb4ca49d47d620682fb00a Apr 14 17:17:46 user devstack@n-api.service[61933]: X-User-Name: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:17:46 user devstack@n-api.service[61933]: method: > Apr 14 17:17:46 user devstack@n-api.service[61933]: exception: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. Apr 14 17:17:46 user devstack@n-api.service[61933]: action_args: {'id': '7213d0b2-6eac-449b-aa4b-44088686abac'} Apr 14 17:17:46 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. Apr 14 17:17:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:46 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-122315ad-94d2-41c1-8c7c-95cfb587656f tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Returning 404 to user: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:17:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-122315ad-94d2-41c1-8c7c-95cfb587656f tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac" status: 404 len: 111 microversion: 2.1 time: 0.039724 Apr 14 17:17:46 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 218/665] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:17:46 2023] DELETE /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:17:46 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-9e5aa378-4187-40ed-abd1-3eb55263d3a9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:46 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-9e5aa378-4187-40ed-abd1-3eb55263d3a9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 7213d0b2-6eac-449b-aa4b-44088686abac] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-9e5aa378-4187-40ed-abd1-3eb55263d3a9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-9e5aa378-4187-40ed-abd1-3eb55263d3a9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-9e5aa378-4187-40ed-abd1-3eb55263d3a9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-9e5aa378-4187-40ed-abd1-3eb55263d3a9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-9e5aa378-4187-40ed-abd1-3eb55263d3a9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-9e5aa378-4187-40ed-abd1-3eb55263d3a9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:46 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-9e5aa378-4187-40ed-abd1-3eb55263d3a9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] HTTP exception thrown: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. Apr 14 17:17:46 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-9e5aa378-4187-40ed-abd1-3eb55263d3a9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Request method failure captured: Apr 14 17:17:46 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac HTTP/1.1 Apr 14 17:17:46 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:17:46 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:17:46 user devstack@n-api.service[61934]: Connection: close Apr 14 17:17:46 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:17:46 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:17:46 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:17:46 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:17:46 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:17:46 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYdYtBTMjEs6wq_AX7uLwl48FezTrz7FyW6CSVOm9G6i0ttgahwJf1S74Fss_9qd0JO9t5wr7pQDv25cSrw7tI0XNOdCBZPRJQlF-w0w2Xn2ZRZ5EUArK2xGuE0HglaJJpHNyoLBzYQsp9Av8_ba24psGn8qYzpzCLzlLWiMZvDXQQQ Apr 14 17:17:46 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:17:46 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:17:46 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:17:46 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:17:46 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:17:46 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:17:46 user devstack@n-api.service[61934]: X-Project-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:17:46 user devstack@n-api.service[61934]: X-Project-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:46 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:17:46 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:17:46 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6f341a2096b9483787b569a59f325556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:17:46 user devstack@n-api.service[61934]: X-Tenant: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:46 user devstack@n-api.service[61934]: X-Tenant-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:17:46 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:46 user devstack@n-api.service[61934]: X-User: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:17:46 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:17:46 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:17:46 user devstack@n-api.service[61934]: X-User-Id: d9c9e0d318eb4ca49d47d620682fb00a Apr 14 17:17:46 user devstack@n-api.service[61934]: X-User-Name: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:17:46 user devstack@n-api.service[61934]: method: > Apr 14 17:17:46 user devstack@n-api.service[61934]: exception: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. Apr 14 17:17:46 user devstack@n-api.service[61934]: action_args: {'id': '7213d0b2-6eac-449b-aa4b-44088686abac'} Apr 14 17:17:46 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. Apr 14 17:17:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:17:46 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-9e5aa378-4187-40ed-abd1-3eb55263d3a9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Returning 404 to user: Instance 7213d0b2-6eac-449b-aa4b-44088686abac could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:17:46 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-9e5aa378-4187-40ed-abd1-3eb55263d3a9 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac" status: 404 len: 111 microversion: 2.1 time: 0.061547 Apr 14 17:17:46 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 223/666] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:17:46 2023] GET /compute/v2.1/servers/7213d0b2-6eac-449b-aa4b-44088686abac => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:17:46 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-c2a17f3c-6ea7-469b-ab6e-2a54718274af tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:46 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-c2a17f3c-6ea7-469b-ab6e-2a54718274af tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c2a17f3c-6ea7-469b-ab6e-2a54718274af tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c2a17f3c-6ea7-469b-ab6e-2a54718274af tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c2a17f3c-6ea7-469b-ab6e-2a54718274af tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c2a17f3c-6ea7-469b-ab6e-2a54718274af tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c2a17f3c-6ea7-469b-ab6e-2a54718274af tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c2a17f3c-6ea7-469b-ab6e-2a54718274af tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:46 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-c2a17f3c-6ea7-469b-ab6e-2a54718274af tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] HTTP exception thrown: Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd could not be found. Apr 14 17:17:47 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-c2a17f3c-6ea7-469b-ab6e-2a54718274af tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Request method failure captured: Apr 14 17:17:47 user devstack@n-api.service[61935]: request: DELETE /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd HTTP/1.1 Apr 14 17:17:47 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:17:47 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:17:47 user devstack@n-api.service[61935]: Connection: close Apr 14 17:17:47 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:17:47 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:17:47 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:17:47 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:17:47 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:17:47 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYdYtBTMjEs6wq_AX7uLwl48FezTrz7FyW6CSVOm9G6i0ttgahwJf1S74Fss_9qd0JO9t5wr7pQDv25cSrw7tI0XNOdCBZPRJQlF-w0w2Xn2ZRZ5EUArK2xGuE0HglaJJpHNyoLBzYQsp9Av8_ba24psGn8qYzpzCLzlLWiMZvDXQQQ Apr 14 17:17:47 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:17:47 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:17:47 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:17:47 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:17:47 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:17:47 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:17:47 user devstack@n-api.service[61935]: X-Project-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:17:47 user devstack@n-api.service[61935]: X-Project-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:47 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:17:47 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:17:47 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6f341a2096b9483787b569a59f325556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:17:47 user devstack@n-api.service[61935]: X-Tenant: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:47 user devstack@n-api.service[61935]: X-Tenant-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:17:47 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:47 user devstack@n-api.service[61935]: X-User: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:17:47 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:17:47 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:17:47 user devstack@n-api.service[61935]: X-User-Id: d9c9e0d318eb4ca49d47d620682fb00a Apr 14 17:17:47 user devstack@n-api.service[61935]: X-User-Name: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:17:47 user devstack@n-api.service[61935]: method: > Apr 14 17:17:47 user devstack@n-api.service[61935]: exception: Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd could not be found. Apr 14 17:17:47 user devstack@n-api.service[61935]: action_args: {'id': '3469a45b-e63a-4871-a6c5-deece7f4ecfd'} Apr 14 17:17:47 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd could not be found. Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd could not be found. Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd could not be found. Apr 14 17:17:47 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:47 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-c2a17f3c-6ea7-469b-ab6e-2a54718274af tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Returning 404 to user: Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:17:47 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-c2a17f3c-6ea7-469b-ab6e-2a54718274af tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd" status: 404 len: 111 microversion: 2.1 time: 0.036558 Apr 14 17:17:47 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 226/667] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:17:46 2023] DELETE /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 17:17:47 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d6fe865f-fa49-4663-bc8d-cfa49da416e7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:47 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-d6fe865f-fa49-4663-bc8d-cfa49da416e7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: 3469a45b-e63a-4871-a6c5-deece7f4ecfd] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6fe865f-fa49-4663-bc8d-cfa49da416e7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6fe865f-fa49-4663-bc8d-cfa49da416e7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6fe865f-fa49-4663-bc8d-cfa49da416e7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6fe865f-fa49-4663-bc8d-cfa49da416e7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6fe865f-fa49-4663-bc8d-cfa49da416e7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6fe865f-fa49-4663-bc8d-cfa49da416e7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:47 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-d6fe865f-fa49-4663-bc8d-cfa49da416e7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] HTTP exception thrown: Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd could not be found. Apr 14 17:17:47 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d6fe865f-fa49-4663-bc8d-cfa49da416e7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Request method failure captured: Apr 14 17:17:47 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd HTTP/1.1 Apr 14 17:17:47 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:17:47 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:17:47 user devstack@n-api.service[61933]: Connection: close Apr 14 17:17:47 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:17:47 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:17:47 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:17:47 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:17:47 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:17:47 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYdYtBTMjEs6wq_AX7uLwl48FezTrz7FyW6CSVOm9G6i0ttgahwJf1S74Fss_9qd0JO9t5wr7pQDv25cSrw7tI0XNOdCBZPRJQlF-w0w2Xn2ZRZ5EUArK2xGuE0HglaJJpHNyoLBzYQsp9Av8_ba24psGn8qYzpzCLzlLWiMZvDXQQQ Apr 14 17:17:47 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:17:47 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:17:47 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:17:47 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:17:47 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:17:47 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:17:47 user devstack@n-api.service[61933]: X-Project-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:17:47 user devstack@n-api.service[61933]: X-Project-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:47 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:17:47 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:17:47 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6f341a2096b9483787b569a59f325556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:17:47 user devstack@n-api.service[61933]: X-Tenant: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:47 user devstack@n-api.service[61933]: X-Tenant-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:17:47 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:47 user devstack@n-api.service[61933]: X-User: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:17:47 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:17:47 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:17:47 user devstack@n-api.service[61933]: X-User-Id: d9c9e0d318eb4ca49d47d620682fb00a Apr 14 17:17:47 user devstack@n-api.service[61933]: X-User-Name: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:17:47 user devstack@n-api.service[61933]: method: > Apr 14 17:17:47 user devstack@n-api.service[61933]: exception: Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd could not be found. Apr 14 17:17:47 user devstack@n-api.service[61933]: action_args: {'id': '3469a45b-e63a-4871-a6c5-deece7f4ecfd'} Apr 14 17:17:47 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd could not be found. Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd could not be found. Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd could not be found. Apr 14 17:17:47 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:17:47 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d6fe865f-fa49-4663-bc8d-cfa49da416e7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Returning 404 to user: Instance 3469a45b-e63a-4871-a6c5-deece7f4ecfd could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:17:47 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d6fe865f-fa49-4663-bc8d-cfa49da416e7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd" status: 404 len: 111 microversion: 2.1 time: 0.034081 Apr 14 17:17:47 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 219/668] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:17:47 2023] GET /compute/v2.1/servers/3469a45b-e63a-4871-a6c5-deece7f4ecfd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:17:47 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-ebcb37fe-2049-46e0-b213-90cc16e5615b req-f10c96d1-d9f5-42bf-ad73-12238d20d168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715", "tag": "43e76338-e6dd-456e-b1e2-d2f7c150f14d"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:17:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ebcb37fe-2049-46e0-b213-90cc16e5615b req-f10c96d1-d9f5-42bf-ad73-12238d20d168 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ebcb37fe-2049-46e0-b213-90cc16e5615b req-f10c96d1-d9f5-42bf-ad73-12238d20d168 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ebcb37fe-2049-46e0-b213-90cc16e5615b req-f10c96d1-d9f5-42bf-ad73-12238d20d168 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:47 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-ebcb37fe-2049-46e0-b213-90cc16e5615b req-f10c96d1-d9f5-42bf-ad73-12238d20d168 service nova] Creating event network-changed:43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 on user Apr 14 17:17:47 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-ebcb37fe-2049-46e0-b213-90cc16e5615b req-f10c96d1-d9f5-42bf-ad73-12238d20d168 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043726 Apr 14 17:17:47 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 224/669] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:17:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:17:49 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-65df8af4-c6a2-4f07-ab46-6d6fb5957d58 req-e2c52dee-cd32-4095-9c9f-a61f4a439b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715", "name": "network-vif-plugged", "status": "completed", "tag": "43e76338-e6dd-456e-b1e2-d2f7c150f14d"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:17:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-65df8af4-c6a2-4f07-ab46-6d6fb5957d58 req-e2c52dee-cd32-4095-9c9f-a61f4a439b2e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-65df8af4-c6a2-4f07-ab46-6d6fb5957d58 req-e2c52dee-cd32-4095-9c9f-a61f4a439b2e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-65df8af4-c6a2-4f07-ab46-6d6fb5957d58 req-e2c52dee-cd32-4095-9c9f-a61f4a439b2e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:49 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-65df8af4-c6a2-4f07-ab46-6d6fb5957d58 req-e2c52dee-cd32-4095-9c9f-a61f4a439b2e service nova] Creating event network-vif-plugged:43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 on user Apr 14 17:17:49 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-65df8af4-c6a2-4f07-ab46-6d6fb5957d58 req-e2c52dee-cd32-4095-9c9f-a61f4a439b2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030972 Apr 14 17:17:49 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 227/670] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:17:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:17:49 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-5ac44990-9c38-4cbd-be07-8fd0181aaf3e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:49 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-5ac44990-9c38-4cbd-be07-8fd0181aaf3e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5ac44990-9c38-4cbd-be07-8fd0181aaf3e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5ac44990-9c38-4cbd-be07-8fd0181aaf3e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5ac44990-9c38-4cbd-be07-8fd0181aaf3e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5ac44990-9c38-4cbd-be07-8fd0181aaf3e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5ac44990-9c38-4cbd-be07-8fd0181aaf3e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5ac44990-9c38-4cbd-be07-8fd0181aaf3e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:50 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-5ac44990-9c38-4cbd-be07-8fd0181aaf3e tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.206210 Apr 14 17:17:50 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 220/671] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 17:17:49 2023] GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd/os-interface => generated 282 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 17:17:50 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-32eacddd-0518-43fb-bd56-86c311d638c7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:50 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-32eacddd-0518-43fb-bd56-86c311d638c7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-32eacddd-0518-43fb-bd56-86c311d638c7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-32eacddd-0518-43fb-bd56-86c311d638c7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-32eacddd-0518-43fb-bd56-86c311d638c7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-32eacddd-0518-43fb-bd56-86c311d638c7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-32eacddd-0518-43fb-bd56-86c311d638c7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-32eacddd-0518-43fb-bd56-86c311d638c7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:50 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-32eacddd-0518-43fb-bd56-86c311d638c7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] HTTP exception thrown: Instance c0488788-7b88-4c48-9fcd-02640c09feb1 could not be found. Apr 14 17:17:50 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-32eacddd-0518-43fb-bd56-86c311d638c7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Request method failure captured: Apr 14 17:17:50 user devstack@n-api.service[61934]: request: DELETE /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1 HTTP/1.1 Apr 14 17:17:50 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:17:50 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:17:50 user devstack@n-api.service[61934]: Connection: close Apr 14 17:17:50 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:17:50 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:17:50 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:17:50 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:17:50 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:17:50 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYdYtBTMjEs6wq_AX7uLwl48FezTrz7FyW6CSVOm9G6i0ttgahwJf1S74Fss_9qd0JO9t5wr7pQDv25cSrw7tI0XNOdCBZPRJQlF-w0w2Xn2ZRZ5EUArK2xGuE0HglaJJpHNyoLBzYQsp9Av8_ba24psGn8qYzpzCLzlLWiMZvDXQQQ Apr 14 17:17:50 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:17:50 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:17:50 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:17:50 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:17:50 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:17:50 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:17:50 user devstack@n-api.service[61934]: X-Project-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:17:50 user devstack@n-api.service[61934]: X-Project-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:50 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:17:50 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:17:50 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6f341a2096b9483787b569a59f325556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:17:50 user devstack@n-api.service[61934]: X-Tenant: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:50 user devstack@n-api.service[61934]: X-Tenant-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:17:50 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:50 user devstack@n-api.service[61934]: X-User: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:17:50 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:17:50 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:17:50 user devstack@n-api.service[61934]: X-User-Id: d9c9e0d318eb4ca49d47d620682fb00a Apr 14 17:17:50 user devstack@n-api.service[61934]: X-User-Name: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:17:50 user devstack@n-api.service[61934]: method: > Apr 14 17:17:50 user devstack@n-api.service[61934]: exception: Instance c0488788-7b88-4c48-9fcd-02640c09feb1 could not be found. Apr 14 17:17:50 user devstack@n-api.service[61934]: action_args: {'id': 'c0488788-7b88-4c48-9fcd-02640c09feb1'} Apr 14 17:17:50 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0488788-7b88-4c48-9fcd-02640c09feb1 could not be found. Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0488788-7b88-4c48-9fcd-02640c09feb1 could not be found. Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0488788-7b88-4c48-9fcd-02640c09feb1 could not be found. Apr 14 17:17:50 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:17:50 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-32eacddd-0518-43fb-bd56-86c311d638c7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Returning 404 to user: Instance c0488788-7b88-4c48-9fcd-02640c09feb1 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:17:50 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-32eacddd-0518-43fb-bd56-86c311d638c7 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1" status: 404 len: 111 microversion: 2.1 time: 0.032333 Apr 14 17:17:50 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 225/672] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:17:50 2023] DELETE /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:17:50 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-c7c24970-0a93-4776-a4df-489e0414c334 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:50 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-c7c24970-0a93-4776-a4df-489e0414c334 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] [instance: c0488788-7b88-4c48-9fcd-02640c09feb1] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c7c24970-0a93-4776-a4df-489e0414c334 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c7c24970-0a93-4776-a4df-489e0414c334 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c7c24970-0a93-4776-a4df-489e0414c334 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c7c24970-0a93-4776-a4df-489e0414c334 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c7c24970-0a93-4776-a4df-489e0414c334 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-c7c24970-0a93-4776-a4df-489e0414c334 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:50 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-c7c24970-0a93-4776-a4df-489e0414c334 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] HTTP exception thrown: Instance c0488788-7b88-4c48-9fcd-02640c09feb1 could not be found. Apr 14 17:17:50 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-c7c24970-0a93-4776-a4df-489e0414c334 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Request method failure captured: Apr 14 17:17:50 user devstack@n-api.service[61935]: request: GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1 HTTP/1.1 Apr 14 17:17:50 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:17:50 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:17:50 user devstack@n-api.service[61935]: Connection: close Apr 14 17:17:50 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:17:50 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:17:50 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:17:50 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:17:50 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:17:50 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYdYtBTMjEs6wq_AX7uLwl48FezTrz7FyW6CSVOm9G6i0ttgahwJf1S74Fss_9qd0JO9t5wr7pQDv25cSrw7tI0XNOdCBZPRJQlF-w0w2Xn2ZRZ5EUArK2xGuE0HglaJJpHNyoLBzYQsp9Av8_ba24psGn8qYzpzCLzlLWiMZvDXQQQ Apr 14 17:17:50 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:17:50 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:17:50 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:17:50 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:17:50 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:17:50 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:17:50 user devstack@n-api.service[61935]: X-Project-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:17:50 user devstack@n-api.service[61935]: X-Project-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:50 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:17:50 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:17:50 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f341a2096b9483787b569a59f325556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6f341a2096b9483787b569a59f325556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:17:50 user devstack@n-api.service[61935]: X-Tenant: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:50 user devstack@n-api.service[61935]: X-Tenant-Id: 6f341a2096b9483787b569a59f325556 Apr 14 17:17:50 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1177875221 Apr 14 17:17:50 user devstack@n-api.service[61935]: X-User: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:17:50 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:17:50 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:17:50 user devstack@n-api.service[61935]: X-User-Id: d9c9e0d318eb4ca49d47d620682fb00a Apr 14 17:17:50 user devstack@n-api.service[61935]: X-User-Name: tempest-AttachVolumeNegativeTest-1177875221-project-member Apr 14 17:17:50 user devstack@n-api.service[61935]: method: > Apr 14 17:17:50 user devstack@n-api.service[61935]: exception: Instance c0488788-7b88-4c48-9fcd-02640c09feb1 could not be found. Apr 14 17:17:50 user devstack@n-api.service[61935]: action_args: {'id': 'c0488788-7b88-4c48-9fcd-02640c09feb1'} Apr 14 17:17:50 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0488788-7b88-4c48-9fcd-02640c09feb1 could not be found. Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0488788-7b88-4c48-9fcd-02640c09feb1 could not be found. Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0488788-7b88-4c48-9fcd-02640c09feb1 could not be found. Apr 14 17:17:50 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:17:50 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-c7c24970-0a93-4776-a4df-489e0414c334 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] Returning 404 to user: Instance c0488788-7b88-4c48-9fcd-02640c09feb1 could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:17:50 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-c7c24970-0a93-4776-a4df-489e0414c334 tempest-AttachVolumeNegativeTest-1177875221 tempest-AttachVolumeNegativeTest-1177875221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1" status: 404 len: 111 microversion: 2.1 time: 0.039932 Apr 14 17:17:50 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 228/673] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:17:50 2023] GET /compute/v2.1/servers/c0488788-7b88-4c48-9fcd-02640c09feb1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:17:51 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-62b3d41b-da53-4a10-b944-216b0af321e0 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:51 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-62b3d41b-da53-4a10-b944-216b0af321e0 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:51 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-62b3d41b-da53-4a10-b944-216b0af321e0 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:51 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-62b3d41b-da53-4a10-b944-216b0af321e0 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:51 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-62b3d41b-da53-4a10-b944-216b0af321e0 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:51 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-62b3d41b-da53-4a10-b944-216b0af321e0 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:51 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-62b3d41b-da53-4a10-b944-216b0af321e0 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:51 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-62b3d41b-da53-4a10-b944-216b0af321e0 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:51 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-62b3d41b-da53-4a10-b944-216b0af321e0 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd/ips" status: 200 len: 110 microversion: 2.20 time: 0.042444 Apr 14 17:17:51 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 221/674] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 17:17:51 2023] GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd/ips => generated 110 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 17:17:51 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715", "name": "network-vif-plugged", "status": "completed", "tag": "43e76338-e6dd-456e-b1e2-d2f7c150f14d"}, {"name": "network-changed", "server_uuid": "49931fa3-281e-43d0-a3e9-fde8f502b2cd", "tag": "fd88804d-f436-4656-89b3-22638cb26897"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:17:51 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:51 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:51 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:51 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] Creating event network-vif-plugged:43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 on user Apr 14 17:17:51 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] Creating event network-changed:fd88804d-f436-4656-89b3-22638cb26897 for instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd on user Apr 14 17:17:51 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-789e2170-ad1b-458e-912b-d6df873b80e3 req-ba9c2657-623e-41d1-87b0-18be5b0ddbd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.059036 Apr 14 17:17:51 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 226/675] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:17:51 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:17:53 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:17:53 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:53 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:53 user devstack@n-api.service[61935]: DEBUG nova.objects.instance [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lazy-loading 'flavor' on Instance uuid 49931fa3-281e-43d0-a3e9-fde8f502b2cd {{(pid=61935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:17:54 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:17:54 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-361a2107-e9a6-4685-aa59-e44c31527bba tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "POST /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd/action" status: 202 len: 0 microversion: 2.20 time: 0.931912 Apr 14 17:17:54 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 229/676] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 17:17:53 2023] POST /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd/action => generated 0 bytes in 934 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:17:54 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-3576ad5a-4e3e-4ae4-ae5f-706fd9ccf1bc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:54 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-3576ad5a-4e3e-4ae4-ae5f-706fd9ccf1bc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3576ad5a-4e3e-4ae4-ae5f-706fd9ccf1bc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3576ad5a-4e3e-4ae4-ae5f-706fd9ccf1bc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3576ad5a-4e3e-4ae4-ae5f-706fd9ccf1bc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3576ad5a-4e3e-4ae4-ae5f-706fd9ccf1bc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3576ad5a-4e3e-4ae4-ae5f-706fd9ccf1bc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3576ad5a-4e3e-4ae4-ae5f-706fd9ccf1bc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:55 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-3576ad5a-4e3e-4ae4-ae5f-706fd9ccf1bc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:17:55 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-3576ad5a-4e3e-4ae4-ae5f-706fd9ccf1bc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:17:55 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-3576ad5a-4e3e-4ae4-ae5f-706fd9ccf1bc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:17:55 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-3576ad5a-4e3e-4ae4-ae5f-706fd9ccf1bc tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd" status: 200 len: 1712 microversion: 2.20 time: 0.320095 Apr 14 17:17:55 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 222/677] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:17:54 2023] GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd => generated 1712 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:17:55 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:17:55 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=10 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:17:55 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-8053d086-f1d6-474a-9590-a61047188cda req-91dedab7-706b-42b1-9362-a488da85b62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49931fa3-281e-43d0-a3e9-fde8f502b2cd", "name": "network-vif-unplugged", "status": "completed", "tag": "fd88804d-f436-4656-89b3-22638cb26897"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:17:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8053d086-f1d6-474a-9590-a61047188cda req-91dedab7-706b-42b1-9362-a488da85b62a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8053d086-f1d6-474a-9590-a61047188cda req-91dedab7-706b-42b1-9362-a488da85b62a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8053d086-f1d6-474a-9590-a61047188cda req-91dedab7-706b-42b1-9362-a488da85b62a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:55 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-8053d086-f1d6-474a-9590-a61047188cda req-91dedab7-706b-42b1-9362-a488da85b62a service nova] Creating event network-vif-unplugged:fd88804d-f436-4656-89b3-22638cb26897 for instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd on user Apr 14 17:17:55 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-8053d086-f1d6-474a-9590-a61047188cda req-91dedab7-706b-42b1-9362-a488da85b62a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046383 Apr 14 17:17:55 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 227/678] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:17:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:17:56 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-431bb436-a016-4246-8b12-62405693089c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:17:56 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-431bb436-a016-4246-8b12-62405693089c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:17:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-431bb436-a016-4246-8b12-62405693089c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-431bb436-a016-4246-8b12-62405693089c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-431bb436-a016-4246-8b12-62405693089c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-431bb436-a016-4246-8b12-62405693089c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-431bb436-a016-4246-8b12-62405693089c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-431bb436-a016-4246-8b12-62405693089c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:56 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-431bb436-a016-4246-8b12-62405693089c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:17:56 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-431bb436-a016-4246-8b12-62405693089c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1729 microversion: 2.1 time: 0.284866 Apr 14 17:17:56 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 230/679] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:17:56 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1729 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:17:57 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-c33851f8-61d2-4957-a6f6-84eb8256c63f req-de901be5-e186-44de-9a9e-62dabb66b7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49931fa3-281e-43d0-a3e9-fde8f502b2cd", "name": "network-vif-plugged", "status": "completed", "tag": "fd88804d-f436-4656-89b3-22638cb26897"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:17:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c33851f8-61d2-4957-a6f6-84eb8256c63f req-de901be5-e186-44de-9a9e-62dabb66b7fb service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:17:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c33851f8-61d2-4957-a6f6-84eb8256c63f req-de901be5-e186-44de-9a9e-62dabb66b7fb service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:17:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c33851f8-61d2-4957-a6f6-84eb8256c63f req-de901be5-e186-44de-9a9e-62dabb66b7fb service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:17:57 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-c33851f8-61d2-4957-a6f6-84eb8256c63f req-de901be5-e186-44de-9a9e-62dabb66b7fb service nova] Creating event network-vif-plugged:fd88804d-f436-4656-89b3-22638cb26897 for instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd on user Apr 14 17:17:57 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-c33851f8-61d2-4957-a6f6-84eb8256c63f req-de901be5-e186-44de-9a9e-62dabb66b7fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031915 Apr 14 17:17:57 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 223/680] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:17:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:18:00 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-313c7cd8-6365-401f-903d-ad561eb58fac req-15e8da88-3fb4-4dbd-99f9-a6817e0b0263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49931fa3-281e-43d0-a3e9-fde8f502b2cd", "tag": "fd88804d-f436-4656-89b3-22638cb26897"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:18:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-313c7cd8-6365-401f-903d-ad561eb58fac req-15e8da88-3fb4-4dbd-99f9-a6817e0b0263 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-313c7cd8-6365-401f-903d-ad561eb58fac req-15e8da88-3fb4-4dbd-99f9-a6817e0b0263 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-313c7cd8-6365-401f-903d-ad561eb58fac req-15e8da88-3fb4-4dbd-99f9-a6817e0b0263 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:00 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-313c7cd8-6365-401f-903d-ad561eb58fac req-15e8da88-3fb4-4dbd-99f9-a6817e0b0263 service nova] Creating event network-changed:fd88804d-f436-4656-89b3-22638cb26897 for instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd on user Apr 14 17:18:00 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-313c7cd8-6365-401f-903d-ad561eb58fac req-15e8da88-3fb4-4dbd-99f9-a6817e0b0263 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033374 Apr 14 17:18:00 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 228/681] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:18:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:18:13 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=18 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:18:13 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:18:13 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1973925730"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:18:13 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:18:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:13 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:18:13 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=24 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:18:13 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-c6b4bbc4-748c-46bb-b0a0-c8d8117f217c tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:18:13 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-c6b4bbc4-748c-46bb-b0a0-c8d8117f217c tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:18:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c6b4bbc4-748c-46bb-b0a0-c8d8117f217c tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c6b4bbc4-748c-46bb-b0a0-c8d8117f217c tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c6b4bbc4-748c-46bb-b0a0-c8d8117f217c tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c6b4bbc4-748c-46bb-b0a0-c8d8117f217c tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c6b4bbc4-748c-46bb-b0a0-c8d8117f217c tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c6b4bbc4-748c-46bb-b0a0-c8d8117f217c tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:14 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-c6b4bbc4-748c-46bb-b0a0-c8d8117f217c tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:18:14 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-c6b4bbc4-748c-46bb-b0a0-c8d8117f217c tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93" status: 200 len: 1503 microversion: 2.1 time: 0.251881 Apr 14 17:18:14 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 224/682] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:18:13 2023] GET /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93 => generated 1503 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:18:14 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-fe2d208b-8bcb-4f16-8641-7e86992ee96f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/action" status: 202 len: 52 microversion: 2.87 time: 0.907584 Apr 14 17:18:14 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 231/683] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 17:18:13 2023] POST /compute/v2.1/servers/a3e1f09c-567e-41d1-9c35-58b8371a1d1c/action => generated 52 bytes in 909 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 17:18:19 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:18:19 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=14 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:18:19 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-3af4970d-ee80-4983-a21e-bf3291ff8261 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:18:19 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-3af4970d-ee80-4983-a21e-bf3291ff8261 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:18:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3af4970d-ee80-4983-a21e-bf3291ff8261 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3af4970d-ee80-4983-a21e-bf3291ff8261 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3af4970d-ee80-4983-a21e-bf3291ff8261 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3af4970d-ee80-4983-a21e-bf3291ff8261 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3af4970d-ee80-4983-a21e-bf3291ff8261 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3af4970d-ee80-4983-a21e-bf3291ff8261 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:19 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-3af4970d-ee80-4983-a21e-bf3291ff8261 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:18:19 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-3af4970d-ee80-4983-a21e-bf3291ff8261 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:18:19 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-3af4970d-ee80-4983-a21e-bf3291ff8261 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:18:19 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-3af4970d-ee80-4983-a21e-bf3291ff8261 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3e1f09c-567e-41d1-9c35-58b8371a1d1c" status: 200 len: 1690 microversion: 2.87 time: 0.309933 Apr 14 17:18:19 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 229/684] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:18:19 2023] GET /compute/v2.1/servers/a3e1f09c-567e-41d1-9c35-58b8371a1d1c => generated 1690 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:18:23 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:18:23 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:18:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:23 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Going to try to terminate instance {{(pid=61933) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:18:23 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-544b10a1-2f76-4587-997a-b9630a8c69c5 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d5dd90e8-4232-4f87-ac96-a5a142e3370c" status: 204 len: 0 microversion: 2.1 time: 0.133287 Apr 14 17:18:23 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 225/685] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:18:23 2023] DELETE /compute/v2.1/servers/d5dd90e8-4232-4f87-ac96-a5a142e3370c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:18:23 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:18:23 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-d1ff74a3-8b97-4d9b-aed1-43c84881ac1d tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:18:23 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-d1ff74a3-8b97-4d9b-aed1-43c84881ac1d tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:18:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d1ff74a3-8b97-4d9b-aed1-43c84881ac1d tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d1ff74a3-8b97-4d9b-aed1-43c84881ac1d tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d1ff74a3-8b97-4d9b-aed1-43c84881ac1d tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d1ff74a3-8b97-4d9b-aed1-43c84881ac1d tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d1ff74a3-8b97-4d9b-aed1-43c84881ac1d tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:23 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d1ff74a3-8b97-4d9b-aed1-43c84881ac1d tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:24 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-b90d5c9f-5725-4ae5-b645-97fa2f6b6df0 req-691b744a-bc21-4197-b0eb-4d920385ebdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5dd90e8-4232-4f87-ac96-a5a142e3370c", "name": "network-vif-unplugged", "status": "completed", "tag": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:18:24 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-d1ff74a3-8b97-4d9b-aed1-43c84881ac1d tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8312ebadc8bf438dbc01dc42c6257a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ed93a0cc2a4b2689cd9d26b7f73a14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:18:24 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b90d5c9f-5725-4ae5-b645-97fa2f6b6df0 req-691b744a-bc21-4197-b0eb-4d920385ebdc service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:24 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b90d5c9f-5725-4ae5-b645-97fa2f6b6df0 req-691b744a-bc21-4197-b0eb-4d920385ebdc service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:24 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-d1ff74a3-8b97-4d9b-aed1-43c84881ac1d tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5dd90e8-4232-4f87-ac96-a5a142e3370c" status: 200 len: 1491 microversion: 2.1 time: 0.294770 Apr 14 17:18:24 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b90d5c9f-5725-4ae5-b645-97fa2f6b6df0 req-691b744a-bc21-4197-b0eb-4d920385ebdc service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:24 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 232/686] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:18:23 2023] GET /compute/v2.1/servers/d5dd90e8-4232-4f87-ac96-a5a142e3370c => generated 1491 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:18:24 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-b90d5c9f-5725-4ae5-b645-97fa2f6b6df0 req-691b744a-bc21-4197-b0eb-4d920385ebdc service nova] Creating event network-vif-unplugged:130d0e48-7ee6-4fe7-9a2d-7ef5042e966b for instance d5dd90e8-4232-4f87-ac96-a5a142e3370c on user Apr 14 17:18:24 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-b90d5c9f-5725-4ae5-b645-97fa2f6b6df0 req-691b744a-bc21-4197-b0eb-4d920385ebdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039026 Apr 14 17:18:24 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 230/687] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:18:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:18:26 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5dd90e8-4232-4f87-ac96-a5a142e3370c", "name": "network-vif-plugged", "status": "completed", "tag": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b"}, {"server_uuid": "d5dd90e8-4232-4f87-ac96-a5a142e3370c", "name": "network-vif-plugged", "status": "completed", "tag": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b"}, {"server_uuid": "d5dd90e8-4232-4f87-ac96-a5a142e3370c", "name": "network-vif-plugged", "status": "completed", "tag": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b"}, {"server_uuid": "d5dd90e8-4232-4f87-ac96-a5a142e3370c", "name": "network-vif-unplugged", "status": "completed", "tag": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b"}, {"server_uuid": "d5dd90e8-4232-4f87-ac96-a5a142e3370c", "name": "network-vif-plugged", "status": "completed", "tag": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b"}, {"server_uuid": "d5dd90e8-4232-4f87-ac96-a5a142e3370c", "name": "network-vif-deleted", "tag": "130d0e48-7ee6-4fe7-9a2d-7ef5042e966b"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:18:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:26 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Creating event network-vif-plugged:130d0e48-7ee6-4fe7-9a2d-7ef5042e966b for instance d5dd90e8-4232-4f87-ac96-a5a142e3370c on user Apr 14 17:18:26 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Creating event network-vif-plugged:130d0e48-7ee6-4fe7-9a2d-7ef5042e966b for instance d5dd90e8-4232-4f87-ac96-a5a142e3370c on user Apr 14 17:18:26 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Creating event network-vif-plugged:130d0e48-7ee6-4fe7-9a2d-7ef5042e966b for instance d5dd90e8-4232-4f87-ac96-a5a142e3370c on user Apr 14 17:18:26 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Creating event network-vif-unplugged:130d0e48-7ee6-4fe7-9a2d-7ef5042e966b for instance d5dd90e8-4232-4f87-ac96-a5a142e3370c on user Apr 14 17:18:26 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Creating event network-vif-plugged:130d0e48-7ee6-4fe7-9a2d-7ef5042e966b for instance d5dd90e8-4232-4f87-ac96-a5a142e3370c on user Apr 14 17:18:26 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] Creating event network-vif-deleted:130d0e48-7ee6-4fe7-9a2d-7ef5042e966b for instance d5dd90e8-4232-4f87-ac96-a5a142e3370c on user Apr 14 17:18:26 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-9e211800-b691-4029-bd6d-607fa8510b7c req-30ceae0e-ddaf-448f-9956-aae1299b848d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.052381 Apr 14 17:18:26 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 226/688] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:18:26 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:18:34 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-5223853b-6ad7-4ee9-8603-eb157c601ad9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:18:34 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-5223853b-6ad7-4ee9-8603-eb157c601ad9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:18:34 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:18:34 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:18:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5223853b-6ad7-4ee9-8603-eb157c601ad9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5223853b-6ad7-4ee9-8603-eb157c601ad9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5223853b-6ad7-4ee9-8603-eb157c601ad9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5223853b-6ad7-4ee9-8603-eb157c601ad9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5223853b-6ad7-4ee9-8603-eb157c601ad9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5223853b-6ad7-4ee9-8603-eb157c601ad9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:34 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-5223853b-6ad7-4ee9-8603-eb157c601ad9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:18:34 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-5223853b-6ad7-4ee9-8603-eb157c601ad9 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" status: 200 len: 1536 microversion: 2.1 time: 0.220815 Apr 14 17:18:34 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 233/689] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:18:34 2023] GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 => generated 1536 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:18:45 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:18:45 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=8 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:18:45 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-0281b759-63b1-4097-820e-1f9c8ce3e465 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:18:45 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-0281b759-63b1-4097-820e-1f9c8ce3e465 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:18:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0281b759-63b1-4097-820e-1f9c8ce3e465 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0281b759-63b1-4097-820e-1f9c8ce3e465 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0281b759-63b1-4097-820e-1f9c8ce3e465 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0281b759-63b1-4097-820e-1f9c8ce3e465 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0281b759-63b1-4097-820e-1f9c8ce3e465 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0281b759-63b1-4097-820e-1f9c8ce3e465 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:45 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-0281b759-63b1-4097-820e-1f9c8ce3e465 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:18:45 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-0281b759-63b1-4097-820e-1f9c8ce3e465 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:18:45 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-0281b759-63b1-4097-820e-1f9c8ce3e465 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:18:45 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-0281b759-63b1-4097-820e-1f9c8ce3e465 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd" status: 200 len: 1653 microversion: 2.20 time: 0.264018 Apr 14 17:18:45 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 231/690] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:18:45 2023] GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd => generated 1653 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:18:56 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:18:56 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:18:56 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:18:56 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:18:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:56 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-ba8086c8-ae53-4fa0-9ae9-ace6eb97d3f9 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "POST /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/action" status: 202 len: 0 microversion: 2.1 time: 0.191492 Apr 14 17:18:56 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 227/691] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:18:56 2023] POST /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:18:56 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-ef8921c5-68ff-4d6b-8e67-8b94bedaf978 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:18:56 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-ef8921c5-68ff-4d6b-8e67-8b94bedaf978 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:18:56 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:18:56 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:18:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ef8921c5-68ff-4d6b-8e67-8b94bedaf978 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ef8921c5-68ff-4d6b-8e67-8b94bedaf978 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ef8921c5-68ff-4d6b-8e67-8b94bedaf978 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ef8921c5-68ff-4d6b-8e67-8b94bedaf978 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ef8921c5-68ff-4d6b-8e67-8b94bedaf978 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ef8921c5-68ff-4d6b-8e67-8b94bedaf978 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:57 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-ef8921c5-68ff-4d6b-8e67-8b94bedaf978 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:18:57 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-ef8921c5-68ff-4d6b-8e67-8b94bedaf978 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1728 microversion: 2.1 time: 0.386177 Apr 14 17:18:57 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 234/692] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:18:56 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1728 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:18:58 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-3ffe9148-c344-42fc-a0e1-2b67c4ff6883 req-408fbcc6-980a-457a-bd01-0720b9b4f1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "name": "network-vif-unplugged", "status": "completed", "tag": "de268504-352a-4d08-8113-a2098b794478"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:18:58 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:18:58 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:18:58 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3ffe9148-c344-42fc-a0e1-2b67c4ff6883 req-408fbcc6-980a-457a-bd01-0720b9b4f1f1 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:18:58 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3ffe9148-c344-42fc-a0e1-2b67c4ff6883 req-408fbcc6-980a-457a-bd01-0720b9b4f1f1 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:18:58 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3ffe9148-c344-42fc-a0e1-2b67c4ff6883 req-408fbcc6-980a-457a-bd01-0720b9b4f1f1 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:18:58 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-3ffe9148-c344-42fc-a0e1-2b67c4ff6883 req-408fbcc6-980a-457a-bd01-0720b9b4f1f1 service nova] Creating event network-vif-unplugged:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:18:58 user devstack@n-api.service[61934]: DEBUG nova.compute.api [req-3ffe9148-c344-42fc-a0e1-2b67c4ff6883 req-408fbcc6-980a-457a-bd01-0720b9b4f1f1 service nova] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61934) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 17:18:58 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-3ffe9148-c344-42fc-a0e1-2b67c4ff6883 req-408fbcc6-980a-457a-bd01-0720b9b4f1f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055025 Apr 14 17:18:58 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 232/693] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:18:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:19:00 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-c7e5609c-eea2-4e5c-9c0c-01f2594569f5 req-1201dc1c-3e28-44ab-9063-d14edfae88c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "name": "network-vif-plugged", "status": "completed", "tag": "de268504-352a-4d08-8113-a2098b794478"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c7e5609c-eea2-4e5c-9c0c-01f2594569f5 req-1201dc1c-3e28-44ab-9063-d14edfae88c7 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c7e5609c-eea2-4e5c-9c0c-01f2594569f5 req-1201dc1c-3e28-44ab-9063-d14edfae88c7 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c7e5609c-eea2-4e5c-9c0c-01f2594569f5 req-1201dc1c-3e28-44ab-9063-d14edfae88c7 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:00 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-c7e5609c-eea2-4e5c-9c0c-01f2594569f5 req-1201dc1c-3e28-44ab-9063-d14edfae88c7 service nova] Creating event network-vif-plugged:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:19:00 user devstack@n-api.service[61933]: DEBUG nova.compute.api [req-c7e5609c-eea2-4e5c-9c0c-01f2594569f5 req-1201dc1c-3e28-44ab-9063-d14edfae88c7 service nova] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61933) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 17:19:00 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-c7e5609c-eea2-4e5c-9c0c-01f2594569f5 req-1201dc1c-3e28-44ab-9063-d14edfae88c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101906 Apr 14 17:19:00 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 228/694] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:19:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:19:09 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-14648c27-a4eb-467b-b0fc-61eff11aa247 req-c6423ade-ac11-4345-8d07-66d81a5bea43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "name": "network-vif-plugged", "status": "completed", "tag": "de268504-352a-4d08-8113-a2098b794478"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:09 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:09 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:09 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-14648c27-a4eb-467b-b0fc-61eff11aa247 req-c6423ade-ac11-4345-8d07-66d81a5bea43 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:09 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-14648c27-a4eb-467b-b0fc-61eff11aa247 req-c6423ade-ac11-4345-8d07-66d81a5bea43 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:09 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-14648c27-a4eb-467b-b0fc-61eff11aa247 req-c6423ade-ac11-4345-8d07-66d81a5bea43 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:09 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-14648c27-a4eb-467b-b0fc-61eff11aa247 req-c6423ade-ac11-4345-8d07-66d81a5bea43 service nova] Creating event network-vif-plugged:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:19:09 user devstack@n-api.service[61935]: DEBUG nova.compute.api [req-14648c27-a4eb-467b-b0fc-61eff11aa247 req-c6423ade-ac11-4345-8d07-66d81a5bea43 service nova] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61935) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 17:19:09 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-14648c27-a4eb-467b-b0fc-61eff11aa247 req-c6423ade-ac11-4345-8d07-66d81a5bea43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078284 Apr 14 17:19:09 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 235/695] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:19:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:19:11 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:11 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:11 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-2d5c1f5a-5365-4d4f-a0bd-1ea4fb0f98c6 req-7287d2a8-16aa-4a4d-8d54-8c9a550f99be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "name": "network-vif-plugged", "status": "completed", "tag": "de268504-352a-4d08-8113-a2098b794478"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-2d5c1f5a-5365-4d4f-a0bd-1ea4fb0f98c6 req-7287d2a8-16aa-4a4d-8d54-8c9a550f99be service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-2d5c1f5a-5365-4d4f-a0bd-1ea4fb0f98c6 req-7287d2a8-16aa-4a4d-8d54-8c9a550f99be service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-2d5c1f5a-5365-4d4f-a0bd-1ea4fb0f98c6 req-7287d2a8-16aa-4a4d-8d54-8c9a550f99be service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:11 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-2d5c1f5a-5365-4d4f-a0bd-1ea4fb0f98c6 req-7287d2a8-16aa-4a4d-8d54-8c9a550f99be service nova] Creating event network-vif-plugged:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:19:11 user devstack@n-api.service[61934]: DEBUG nova.compute.api [req-2d5c1f5a-5365-4d4f-a0bd-1ea4fb0f98c6 req-7287d2a8-16aa-4a4d-8d54-8c9a550f99be service nova] Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61934) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 17:19:11 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-2d5c1f5a-5365-4d4f-a0bd-1ea4fb0f98c6 req-7287d2a8-16aa-4a4d-8d54-8c9a550f99be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058281 Apr 14 17:19:11 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 233/696] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:19:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:19:14 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:14 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:14 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-4a7f2183-18b4-4f02-a639-57f338a0ca05 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:19:14 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-4a7f2183-18b4-4f02-a639-57f338a0ca05 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] [instance: d5dd90e8-4232-4f87-ac96-a5a142e3370c] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:19:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4a7f2183-18b4-4f02-a639-57f338a0ca05 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4a7f2183-18b4-4f02-a639-57f338a0ca05 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4a7f2183-18b4-4f02-a639-57f338a0ca05 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4a7f2183-18b4-4f02-a639-57f338a0ca05 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4a7f2183-18b4-4f02-a639-57f338a0ca05 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4a7f2183-18b4-4f02-a639-57f338a0ca05 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:14 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-4a7f2183-18b4-4f02-a639-57f338a0ca05 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] HTTP exception thrown: Instance d5dd90e8-4232-4f87-ac96-a5a142e3370c could not be found. Apr 14 17:19:14 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-4a7f2183-18b4-4f02-a639-57f338a0ca05 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Request method failure captured: Apr 14 17:19:14 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/d5dd90e8-4232-4f87-ac96-a5a142e3370c HTTP/1.1 Apr 14 17:19:14 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:19:14 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:19:14 user devstack@n-api.service[61933]: Connection: close Apr 14 17:19:14 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:19:14 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:19:14 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:19:14 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:19:14 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:19:14 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYnKJQiLmhT7OGJNFozbdGXQz1Z6uqduyk0QAtkwY2NFOYUu0dUZ_o_mQ2hsdhh8l-VHeMSV-eZOPTHS4AFDvkn_BB7TkIh6_Vw3w8k9_Gk_sZTNf4Lc-J-1lnxJgTkdWE29iLF9qYiPcgUql14UJEfERRUwVUMlSyO3A8W-Zhv-Cwk Apr 14 17:19:14 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:19:14 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:19:14 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:19:14 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:19:14 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:19:14 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:19:14 user devstack@n-api.service[61933]: X-Project-Id: 65ed93a0cc2a4b2689cd9d26b7f73a14 Apr 14 17:19:14 user devstack@n-api.service[61933]: X-Project-Name: tempest-VolumesActionsTest-355349757 Apr 14 17:19:14 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:19:14 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:19:14 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65ed93a0cc2a4b2689cd9d26b7f73a14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65ed93a0cc2a4b2689cd9d26b7f73a14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65ed93a0cc2a4b2689cd9d26b7f73a14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:19:14 user devstack@n-api.service[61933]: X-Tenant: tempest-VolumesActionsTest-355349757 Apr 14 17:19:14 user devstack@n-api.service[61933]: X-Tenant-Id: 65ed93a0cc2a4b2689cd9d26b7f73a14 Apr 14 17:19:14 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-VolumesActionsTest-355349757 Apr 14 17:19:14 user devstack@n-api.service[61933]: X-User: tempest-VolumesActionsTest-355349757-project-member Apr 14 17:19:14 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:19:14 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:19:14 user devstack@n-api.service[61933]: X-User-Id: 8312ebadc8bf438dbc01dc42c6257a08 Apr 14 17:19:14 user devstack@n-api.service[61933]: X-User-Name: tempest-VolumesActionsTest-355349757-project-member Apr 14 17:19:14 user devstack@n-api.service[61933]: method: > Apr 14 17:19:14 user devstack@n-api.service[61933]: exception: Instance d5dd90e8-4232-4f87-ac96-a5a142e3370c could not be found. Apr 14 17:19:14 user devstack@n-api.service[61933]: action_args: {'id': 'd5dd90e8-4232-4f87-ac96-a5a142e3370c'} Apr 14 17:19:14 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5dd90e8-4232-4f87-ac96-a5a142e3370c could not be found. Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5dd90e8-4232-4f87-ac96-a5a142e3370c could not be found. Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5dd90e8-4232-4f87-ac96-a5a142e3370c could not be found. Apr 14 17:19:14 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:19:14 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-4a7f2183-18b4-4f02-a639-57f338a0ca05 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] Returning 404 to user: Instance d5dd90e8-4232-4f87-ac96-a5a142e3370c could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:19:14 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-4a7f2183-18b4-4f02-a639-57f338a0ca05 tempest-VolumesActionsTest-355349757 tempest-VolumesActionsTest-355349757-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5dd90e8-4232-4f87-ac96-a5a142e3370c" status: 404 len: 111 microversion: 2.1 time: 0.265780 Apr 14 17:19:14 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 229/697] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:19:14 2023] GET /compute/v2.1/servers/d5dd90e8-4232-4f87-ac96-a5a142e3370c => generated 111 bytes in 268 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:19:16 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-c6bf1d91-f3b6-465a-be71-96dff7c37b6c tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Action: 'create', calling method: .version_select at 0x7fe19cd1add0>, body: {"keypair": {"name": "tempest-keypair-167549610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkhzx0v+7HCaZJW3pk9TowcDAVJ9KFpdiCNY5OOsCtGsGIFyP4OqSdppPhYkTIq5yQOHS6w//2BPtL2ClUJ4uuMEC/DjDyTWFx1NhxIBjDDsrLaSzKGJ838USTQRm0i2Q=="}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:16 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-c6bf1d91-f3b6-465a-be71-96dff7c37b6c tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Getting quotas for project 070c6b9f620548b183904d1971f35752. Resources: {'key_pairs'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:19:16 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-c6bf1d91-f3b6-465a-be71-96dff7c37b6c tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Getting quotas for user 2434278fe61447fab1f5a930aa16a1de and project 070c6b9f620548b183904d1971f35752. Resources: {'key_pairs'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:19:16 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-c6bf1d91-f3b6-465a-be71-96dff7c37b6c tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052088 Apr 14 17:19:16 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 236/698] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 17:19:16 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:19:18 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1625534792", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c5b14da6-ae55-4be0-bbe8-7e1259cadfc3"}], "security_groups": [{"name": "tempest-securitygroup--328697910"}], "key_name": "tempest-keypair-167549610", "user_data": "}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:18 user devstack@n-api.service[61934]: DEBUG nova.network.neutron [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] validate_networks() for [('c5b14da6-ae55-4be0-bbe8-7e1259cadfc3', None, None, None, None, None)] {{(pid=61934) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:19:19 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:19:19 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:19:19 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:19:19 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:19:19 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:19:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:19 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Getting quotas for project 070c6b9f620548b183904d1971f35752. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:19:19 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Getting quotas for user 2434278fe61447fab1f5a930aa16a1de and project 070c6b9f620548b183904d1971f35752. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:19:19 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Going to run 1 instances... {{(pid=61934) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:19:19 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:19:19 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-084efde8-4540-42c2-be63-b98606b91677 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.946391 Apr 14 17:19:19 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 234/699] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:19:18 2023] POST /compute/v2.1/servers => generated 406 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:19:19 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-9d8b4c7c-4d67-4337-ba2a-2cbaa2431e53 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:19:19 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-9d8b4c7c-4d67-4337-ba2a-2cbaa2431e53 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:19:19 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-9d8b4c7c-4d67-4337-ba2a-2cbaa2431e53 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:19:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-9d8b4c7c-4d67-4337-ba2a-2cbaa2431e53 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c" status: 200 len: 1239 microversion: 2.1 time: 0.111113 Apr 14 17:19:19 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 230/700] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:19:19 2023] GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c => generated 1239 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:19:20 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:20 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-645603562", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "b0124a46-3c94-42d9-9961-82730022fc5b", "destination_type": "volume"}], "networks": [{"uuid": "d6985162-5d80-43b0-a99f-e724ada7fdf4"}]}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:20 user devstack@n-api.service[61935]: DEBUG nova.network.neutron [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] validate_networks() for [('d6985162-5d80-43b0-a99f-e724ada7fdf4', None, None, None, None, None)] {{(pid=61935) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:19:20 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:19:20 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:19:20 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Flavor pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:19:20 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Image pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:19:20 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:19:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:20 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Getting quotas for project 965bd22f61df40bd89e8ef35fb12bcd3. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:19:20 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Getting quotas for user b5c86125160643958349100fb3a7855b and project 965bd22f61df40bd89e8ef35fb12bcd3. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:19:20 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Going to run 1 instances... {{(pid=61935) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:19:20 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:19:20 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-1ec40c1c-06ff-4af7-b3cf-e2374021231b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.778477 Apr 14 17:19:20 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 237/701] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 17:19:20 2023] POST /compute/v2.1/servers => generated 378 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 17:19:20 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-48ed83c0-03a8-4ad6-a8c8-65459b547410 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:19:20 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-48ed83c0-03a8-4ad6-a8c8-65459b547410 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:19:20 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-48ed83c0-03a8-4ad6-a8c8-65459b547410 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:19:21 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-48ed83c0-03a8-4ad6-a8c8-65459b547410 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:19:21 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-48ed83c0-03a8-4ad6-a8c8-65459b547410 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:19:21 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-48ed83c0-03a8-4ad6-a8c8-65459b547410 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" status: 200 len: 1394 microversion: 2.87 time: 0.116030 Apr 14 17:19:21 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 235/702] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:19:20 2023] GET /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 => generated 1394 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:19:22 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-e8a727a0-16c7-4d43-8141-b2b09d2482fd req-bcefc3c9-b474-4581-91cf-3584f546ea64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-e8a727a0-16c7-4d43-8141-b2b09d2482fd req-bcefc3c9-b474-4581-91cf-3584f546ea64 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-e8a727a0-16c7-4d43-8141-b2b09d2482fd req-bcefc3c9-b474-4581-91cf-3584f546ea64 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-e8a727a0-16c7-4d43-8141-b2b09d2482fd req-bcefc3c9-b474-4581-91cf-3584f546ea64 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:22 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-e8a727a0-16c7-4d43-8141-b2b09d2482fd req-bcefc3c9-b474-4581-91cf-3584f546ea64 service nova] Creating event network-changed:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:19:22 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-e8a727a0-16c7-4d43-8141-b2b09d2482fd req-bcefc3c9-b474-4581-91cf-3584f546ea64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106894 Apr 14 17:19:22 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 231/703] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:19:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:19:24 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-bef408d2-7614-4479-b817-b02a237a4b11 req-b8725b10-239a-4029-88d9-5e1a8befc700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3", "tag": "9262ab81-5611-4d5e-b32b-082b3c4981fd"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:24 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-bef408d2-7614-4479-b817-b02a237a4b11 req-b8725b10-239a-4029-88d9-5e1a8befc700 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:24 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-bef408d2-7614-4479-b817-b02a237a4b11 req-b8725b10-239a-4029-88d9-5e1a8befc700 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:24 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-bef408d2-7614-4479-b817-b02a237a4b11 req-b8725b10-239a-4029-88d9-5e1a8befc700 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:24 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-bef408d2-7614-4479-b817-b02a237a4b11 req-b8725b10-239a-4029-88d9-5e1a8befc700 service nova] Creating event network-changed:9262ab81-5611-4d5e-b32b-082b3c4981fd for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 on user Apr 14 17:19:24 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-bef408d2-7614-4479-b817-b02a237a4b11 req-b8725b10-239a-4029-88d9-5e1a8befc700 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035892 Apr 14 17:19:24 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 238/704] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:19:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:19:25 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-a8837909-e124-4b8a-9690-698925f90fa0 req-1c1ee58a-9fae-4ebe-a431-3e7ad4cb413e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "name": "network-vif-plugged", "status": "completed", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a8837909-e124-4b8a-9690-698925f90fa0 req-1c1ee58a-9fae-4ebe-a431-3e7ad4cb413e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a8837909-e124-4b8a-9690-698925f90fa0 req-1c1ee58a-9fae-4ebe-a431-3e7ad4cb413e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a8837909-e124-4b8a-9690-698925f90fa0 req-1c1ee58a-9fae-4ebe-a431-3e7ad4cb413e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:25 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-a8837909-e124-4b8a-9690-698925f90fa0 req-1c1ee58a-9fae-4ebe-a431-3e7ad4cb413e service nova] Creating event network-vif-plugged:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:19:25 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-a8837909-e124-4b8a-9690-698925f90fa0 req-1c1ee58a-9fae-4ebe-a431-3e7ad4cb413e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049830 Apr 14 17:19:25 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 236/705] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:19:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:19:27 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-7da83b51-1d6a-4d08-818a-4fbd4579b047 req-2c6c880f-7c48-45b6-8af1-ddfec6945e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "name": "network-vif-plugged", "status": "completed", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-7da83b51-1d6a-4d08-818a-4fbd4579b047 req-2c6c880f-7c48-45b6-8af1-ddfec6945e10 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-7da83b51-1d6a-4d08-818a-4fbd4579b047 req-2c6c880f-7c48-45b6-8af1-ddfec6945e10 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-7da83b51-1d6a-4d08-818a-4fbd4579b047 req-2c6c880f-7c48-45b6-8af1-ddfec6945e10 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:27 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-7da83b51-1d6a-4d08-818a-4fbd4579b047 req-2c6c880f-7c48-45b6-8af1-ddfec6945e10 service nova] Creating event network-vif-plugged:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:19:27 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-7da83b51-1d6a-4d08-818a-4fbd4579b047 req-2c6c880f-7c48-45b6-8af1-ddfec6945e10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052963 Apr 14 17:19:27 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 232/706] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:19:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:19:34 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:34 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=10 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:34 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:34 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:34 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-9d9d5189-22e9-475c-ae53-1d37a630a986 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:19:34 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-9d9d5189-22e9-475c-ae53-1d37a630a986 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:19:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9d9d5189-22e9-475c-ae53-1d37a630a986 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9d9d5189-22e9-475c-ae53-1d37a630a986 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9d9d5189-22e9-475c-ae53-1d37a630a986 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9d9d5189-22e9-475c-ae53-1d37a630a986 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9d9d5189-22e9-475c-ae53-1d37a630a986 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9d9d5189-22e9-475c-ae53-1d37a630a986 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:35 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-9d9d5189-22e9-475c-ae53-1d37a630a986 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:19:35 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-9d9d5189-22e9-475c-ae53-1d37a630a986 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" status: 200 len: 1536 microversion: 2.1 time: 0.366899 Apr 14 17:19:35 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 239/707] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:19:34 2023] GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 => generated 1536 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:19:35 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:35 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=8 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:35 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-fd086938-24db-4199-9f4a-8706c1475640 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:19:35 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-fd086938-24db-4199-9f4a-8706c1475640 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:19:35 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-fd086938-24db-4199-9f4a-8706c1475640 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Searching by: {'deleted': False, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac'} {{(pid=61934) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 17:19:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fd086938-24db-4199-9f4a-8706c1475640 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fd086938-24db-4199-9f4a-8706c1475640 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fd086938-24db-4199-9f4a-8706c1475640 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fd086938-24db-4199-9f4a-8706c1475640 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fd086938-24db-4199-9f4a-8706c1475640 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fd086938-24db-4199-9f4a-8706c1475640 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:35 user devstack@n-api.service[61934]: DEBUG nova.compute.multi_cell_list [None req-fd086938-24db-4199-9f4a-8706c1475640 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61934) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 17:19:35 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-fd086938-24db-4199-9f4a-8706c1475640 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.149119 Apr 14 17:19:35 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 237/708] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 17:19:35 2023] GET /compute/v2.1/servers => generated 341 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:19:35 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:35 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-0ae2f326-79d8-4720-892f-ec414ea98afd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:19:35 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-0ae2f326-79d8-4720-892f-ec414ea98afd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:19:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0ae2f326-79d8-4720-892f-ec414ea98afd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0ae2f326-79d8-4720-892f-ec414ea98afd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0ae2f326-79d8-4720-892f-ec414ea98afd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0ae2f326-79d8-4720-892f-ec414ea98afd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0ae2f326-79d8-4720-892f-ec414ea98afd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0ae2f326-79d8-4720-892f-ec414ea98afd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:35 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-0ae2f326-79d8-4720-892f-ec414ea98afd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:19:35 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-0ae2f326-79d8-4720-892f-ec414ea98afd tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" status: 200 len: 1536 microversion: 2.1 time: 0.643505 Apr 14 17:19:35 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 233/709] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:19:35 2023] GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 => generated 1536 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 17:19:39 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-10b17e32-060c-41ec-a4db-0d2e9b40f703 req-c8377897-cb0e-4e42-ac70-5d034e084df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3", "name": "network-vif-plugged", "status": "completed", "tag": "9262ab81-5611-4d5e-b32b-082b3c4981fd"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-10b17e32-060c-41ec-a4db-0d2e9b40f703 req-c8377897-cb0e-4e42-ac70-5d034e084df5 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-10b17e32-060c-41ec-a4db-0d2e9b40f703 req-c8377897-cb0e-4e42-ac70-5d034e084df5 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-10b17e32-060c-41ec-a4db-0d2e9b40f703 req-c8377897-cb0e-4e42-ac70-5d034e084df5 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:39 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-10b17e32-060c-41ec-a4db-0d2e9b40f703 req-c8377897-cb0e-4e42-ac70-5d034e084df5 service nova] Creating event network-vif-plugged:9262ab81-5611-4d5e-b32b-082b3c4981fd for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 on user Apr 14 17:19:39 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-10b17e32-060c-41ec-a4db-0d2e9b40f703 req-c8377897-cb0e-4e42-ac70-5d034e084df5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033745 Apr 14 17:19:39 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 240/710] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:19:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 17:19:41 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-68615f8f-2092-43f0-a3ea-992a06510338 req-c8055274-7344-4c74-952d-d63b1a600260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3", "name": "network-vif-plugged", "status": "completed", "tag": "9262ab81-5611-4d5e-b32b-082b3c4981fd"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:41 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-68615f8f-2092-43f0-a3ea-992a06510338 req-c8055274-7344-4c74-952d-d63b1a600260 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-68615f8f-2092-43f0-a3ea-992a06510338 req-c8055274-7344-4c74-952d-d63b1a600260 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:41 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-68615f8f-2092-43f0-a3ea-992a06510338 req-c8055274-7344-4c74-952d-d63b1a600260 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:41 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=17 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:41 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-68615f8f-2092-43f0-a3ea-992a06510338 req-c8055274-7344-4c74-952d-d63b1a600260 service nova] Creating event network-vif-plugged:9262ab81-5611-4d5e-b32b-082b3c4981fd for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 on user Apr 14 17:19:41 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-68615f8f-2092-43f0-a3ea-992a06510338 req-c8055274-7344-4c74-952d-d63b1a600260 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185980 Apr 14 17:19:41 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 238/711] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:19:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:19:42 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca8ff0ff-f007-4ffc-ab66-a99af6974027"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:42 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:19:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:43 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-fbca2ebd-0f33-4135-8f98-44536aca39aa tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.992330 Apr 14 17:19:43 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 234/712] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:19:42 2023] POST /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/os-volume_attachments => generated 194 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:19:45 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-37299a21-6cea-4ccb-81cf-439eab7c01be tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2dfdb2a-b0b6-4876-a8f6-0bb6c8b1a76f"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:45 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-37299a21-6cea-4ccb-81cf-439eab7c01be tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:19:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-37299a21-6cea-4ccb-81cf-439eab7c01be tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-37299a21-6cea-4ccb-81cf-439eab7c01be tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-37299a21-6cea-4ccb-81cf-439eab7c01be tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-37299a21-6cea-4ccb-81cf-439eab7c01be tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-37299a21-6cea-4ccb-81cf-439eab7c01be tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-37299a21-6cea-4ccb-81cf-439eab7c01be tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:46 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-37299a21-6cea-4ccb-81cf-439eab7c01be tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "POST /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.788270 Apr 14 17:19:46 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 241/713] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 17:19:45 2023] POST /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd/os-volume_attachments => generated 188 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 17:19:46 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-6cf5f998-8f10-4482-98e5-127e14ed6e2d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:19:46 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-6cf5f998-8f10-4482-98e5-127e14ed6e2d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:19:46 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6cf5f998-8f10-4482-98e5-127e14ed6e2d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6cf5f998-8f10-4482-98e5-127e14ed6e2d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6cf5f998-8f10-4482-98e5-127e14ed6e2d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6cf5f998-8f10-4482-98e5-127e14ed6e2d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6cf5f998-8f10-4482-98e5-127e14ed6e2d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6cf5f998-8f10-4482-98e5-127e14ed6e2d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:46 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-6cf5f998-8f10-4482-98e5-127e14ed6e2d tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd/os-volume_attachments/e2dfdb2a-b0b6-4876-a8f6-0bb6c8b1a76f" status: 202 len: 0 microversion: 2.20 time: 0.345787 Apr 14 17:19:46 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 239/714] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 17:19:46 2023] DELETE /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd/os-volume_attachments/e2dfdb2a-b0b6-4876-a8f6-0bb6c8b1a76f => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:19:46 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:46 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:19:46 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=15 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:46 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:19:47 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61933) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 17:19:47 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-f45bf04a-1c1f-40c7-8adc-535d50020e1b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "POST /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd/action" status: 202 len: 0 microversion: 2.20 time: 0.153422 Apr 14 17:19:47 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 235/715] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 17:19:46 2023] POST /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:19:47 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-671f6bbf-24fa-4f72-8c5d-a4aca1454417 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:19:47 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-671f6bbf-24fa-4f72-8c5d-a4aca1454417 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:19:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-671f6bbf-24fa-4f72-8c5d-a4aca1454417 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-671f6bbf-24fa-4f72-8c5d-a4aca1454417 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-671f6bbf-24fa-4f72-8c5d-a4aca1454417 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-671f6bbf-24fa-4f72-8c5d-a4aca1454417 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-671f6bbf-24fa-4f72-8c5d-a4aca1454417 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-671f6bbf-24fa-4f72-8c5d-a4aca1454417 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:47 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-671f6bbf-24fa-4f72-8c5d-a4aca1454417 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:19:47 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-671f6bbf-24fa-4f72-8c5d-a4aca1454417 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:19:47 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-671f6bbf-24fa-4f72-8c5d-a4aca1454417 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:19:47 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-671f6bbf-24fa-4f72-8c5d-a4aca1454417 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd" status: 200 len: 1661 microversion: 2.20 time: 0.263849 Apr 14 17:19:47 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 242/716] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:19:47 2023] GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd => generated 1661 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:19:47 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-7d1ccd09-cfa4-4f70-8f5e-ee348fdecacd tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:19:47 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-7d1ccd09-cfa4-4f70-8f5e-ee348fdecacd tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:19:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7d1ccd09-cfa4-4f70-8f5e-ee348fdecacd tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7d1ccd09-cfa4-4f70-8f5e-ee348fdecacd tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7d1ccd09-cfa4-4f70-8f5e-ee348fdecacd tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7d1ccd09-cfa4-4f70-8f5e-ee348fdecacd tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7d1ccd09-cfa4-4f70-8f5e-ee348fdecacd tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7d1ccd09-cfa4-4f70-8f5e-ee348fdecacd tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:47 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-7d1ccd09-cfa4-4f70-8f5e-ee348fdecacd tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:19:47 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-7d1ccd09-cfa4-4f70-8f5e-ee348fdecacd tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1721 microversion: 2.1 time: 0.305890 Apr 14 17:19:47 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 240/717] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:19:47 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1721 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:19:49 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-f373734d-e6a2-4597-ba6c-6153af11caed req-73b6bd7c-bac1-408d-9378-e62c49bf588b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49931fa3-281e-43d0-a3e9-fde8f502b2cd", "tag": "fd88804d-f436-4656-89b3-22638cb26897"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-f373734d-e6a2-4597-ba6c-6153af11caed req-73b6bd7c-bac1-408d-9378-e62c49bf588b service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-f373734d-e6a2-4597-ba6c-6153af11caed req-73b6bd7c-bac1-408d-9378-e62c49bf588b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-f373734d-e6a2-4597-ba6c-6153af11caed req-73b6bd7c-bac1-408d-9378-e62c49bf588b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:50 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-f373734d-e6a2-4597-ba6c-6153af11caed req-73b6bd7c-bac1-408d-9378-e62c49bf588b service nova] Creating event network-changed:fd88804d-f436-4656-89b3-22638cb26897 for instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd on user Apr 14 17:19:50 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-f373734d-e6a2-4597-ba6c-6153af11caed req-73b6bd7c-bac1-408d-9378-e62c49bf588b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040575 Apr 14 17:19:50 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 236/718] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:19:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:19:52 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-42c67bb0-2906-42de-9a1a-81e40b0ade65 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:19:52 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-42c67bb0-2906-42de-9a1a-81e40b0ade65 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:19:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-42c67bb0-2906-42de-9a1a-81e40b0ade65 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-42c67bb0-2906-42de-9a1a-81e40b0ade65 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-42c67bb0-2906-42de-9a1a-81e40b0ade65 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-42c67bb0-2906-42de-9a1a-81e40b0ade65 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-42c67bb0-2906-42de-9a1a-81e40b0ade65 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-42c67bb0-2906-42de-9a1a-81e40b0ade65 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:52 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-42c67bb0-2906-42de-9a1a-81e40b0ade65 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:19:52 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-42c67bb0-2906-42de-9a1a-81e40b0ade65 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" status: 200 len: 1582 microversion: 2.1 time: 0.294879 Apr 14 17:19:52 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 243/719] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:19:52 2023] GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 => generated 1582 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:19:54 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-29e8f2d9-7992-40be-b9f0-69fcaaad5ea8 req-2a40d4ef-6af4-452f-87a8-998f6d054a9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715", "tag": "43e76338-e6dd-456e-b1e2-d2f7c150f14d"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-29e8f2d9-7992-40be-b9f0-69fcaaad5ea8 req-2a40d4ef-6af4-452f-87a8-998f6d054a9f service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-29e8f2d9-7992-40be-b9f0-69fcaaad5ea8 req-2a40d4ef-6af4-452f-87a8-998f6d054a9f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-29e8f2d9-7992-40be-b9f0-69fcaaad5ea8 req-2a40d4ef-6af4-452f-87a8-998f6d054a9f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:54 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-29e8f2d9-7992-40be-b9f0-69fcaaad5ea8 req-2a40d4ef-6af4-452f-87a8-998f6d054a9f service nova] Creating event network-changed:43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 on user Apr 14 17:19:54 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-29e8f2d9-7992-40be-b9f0-69fcaaad5ea8 req-2a40d4ef-6af4-452f-87a8-998f6d054a9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046718 Apr 14 17:19:54 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 241/720] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:19:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:19:56 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-95fe3e05-5f7d-48b1-a4c1-0310fdaaafbb req-6ce76b5f-83f4-4aa0-92fc-0a9623d91be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49931fa3-281e-43d0-a3e9-fde8f502b2cd", "name": "network-vif-plugged", "status": "completed", "tag": "fd88804d-f436-4656-89b3-22638cb26897"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-95fe3e05-5f7d-48b1-a4c1-0310fdaaafbb req-6ce76b5f-83f4-4aa0-92fc-0a9623d91be6 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-95fe3e05-5f7d-48b1-a4c1-0310fdaaafbb req-6ce76b5f-83f4-4aa0-92fc-0a9623d91be6 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-95fe3e05-5f7d-48b1-a4c1-0310fdaaafbb req-6ce76b5f-83f4-4aa0-92fc-0a9623d91be6 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:56 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-95fe3e05-5f7d-48b1-a4c1-0310fdaaafbb req-6ce76b5f-83f4-4aa0-92fc-0a9623d91be6 service nova] Creating event network-vif-plugged:fd88804d-f436-4656-89b3-22638cb26897 for instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd on user Apr 14 17:19:56 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-95fe3e05-5f7d-48b1-a4c1-0310fdaaafbb req-6ce76b5f-83f4-4aa0-92fc-0a9623d91be6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041722 Apr 14 17:19:56 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 237/721] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:19:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:19:57 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-2fe6bd02-923c-4439-81d0-ec6f6f1dc6ef tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1357679669"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:57 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-2fe6bd02-923c-4439-81d0-ec6f6f1dc6ef tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:19:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2fe6bd02-923c-4439-81d0-ec6f6f1dc6ef tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2fe6bd02-923c-4439-81d0-ec6f6f1dc6ef tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2fe6bd02-923c-4439-81d0-ec6f6f1dc6ef tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2fe6bd02-923c-4439-81d0-ec6f6f1dc6ef tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2fe6bd02-923c-4439-81d0-ec6f6f1dc6ef tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2fe6bd02-923c-4439-81d0-ec6f6f1dc6ef tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:57 user devstack@n-api.service[61935]: INFO nova.network.security_group_api [None req-2fe6bd02-923c-4439-81d0-ec6f6f1dc6ef tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Adding security group 182c8c3c-44db-4a1c-8ade-8aadab322972 to port 43e76338-e6dd-456e-b1e2-d2f7c150f14d Apr 14 17:19:58 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-2fe6bd02-923c-4439-81d0-ec6f6f1dc6ef tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/action" status: 202 len: 0 microversion: 2.1 time: 1.170166 Apr 14 17:19:58 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 244/722] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:19:57 2023] POST /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/action => generated 0 bytes in 1172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:19:58 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-3faf6040-550c-40ca-9dff-1a0ed4030a54 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:19:58 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-3faf6040-550c-40ca-9dff-1a0ed4030a54 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:19:58 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3faf6040-550c-40ca-9dff-1a0ed4030a54 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:58 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3faf6040-550c-40ca-9dff-1a0ed4030a54 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:58 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3faf6040-550c-40ca-9dff-1a0ed4030a54 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:58 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3faf6040-550c-40ca-9dff-1a0ed4030a54 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:58 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3faf6040-550c-40ca-9dff-1a0ed4030a54 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:58 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3faf6040-550c-40ca-9dff-1a0ed4030a54 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:58 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-af8d8c16-03f2-45a4-8532-6b2b8e486423 req-49913864-9ebb-4a9c-ba9f-b9f7990d4b82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715", "tag": "43e76338-e6dd-456e-b1e2-d2f7c150f14d"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-af8d8c16-03f2-45a4-8532-6b2b8e486423 req-49913864-9ebb-4a9c-ba9f-b9f7990d4b82 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-af8d8c16-03f2-45a4-8532-6b2b8e486423 req-49913864-9ebb-4a9c-ba9f-b9f7990d4b82 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-af8d8c16-03f2-45a4-8532-6b2b8e486423 req-49913864-9ebb-4a9c-ba9f-b9f7990d4b82 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-af8d8c16-03f2-45a4-8532-6b2b8e486423 req-49913864-9ebb-4a9c-ba9f-b9f7990d4b82 service nova] Creating event network-changed:43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 on user Apr 14 17:19:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-af8d8c16-03f2-45a4-8532-6b2b8e486423 req-49913864-9ebb-4a9c-ba9f-b9f7990d4b82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157874 Apr 14 17:19:58 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 238/723] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:19:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 17:19:58 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-3faf6040-550c-40ca-9dff-1a0ed4030a54 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:19:58 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-3faf6040-550c-40ca-9dff-1a0ed4030a54 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" status: 200 len: 1747 microversion: 2.1 time: 0.226158 Apr 14 17:19:58 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 242/724] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:19:58 2023] GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 => generated 1747 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:19:58 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:58 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:19:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:58 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:58 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-13d917fa-aac2-427d-9cc6-062d6cb7c7d3 req-d316dded-b199-4b02-9d93-b685a16b7161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49931fa3-281e-43d0-a3e9-fde8f502b2cd", "name": "network-vif-plugged", "status": "completed", "tag": "fd88804d-f436-4656-89b3-22638cb26897"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:19:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-13d917fa-aac2-427d-9cc6-062d6cb7c7d3 req-d316dded-b199-4b02-9d93-b685a16b7161 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-13d917fa-aac2-427d-9cc6-062d6cb7c7d3 req-d316dded-b199-4b02-9d93-b685a16b7161 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-13d917fa-aac2-427d-9cc6-062d6cb7c7d3 req-d316dded-b199-4b02-9d93-b685a16b7161 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-13d917fa-aac2-427d-9cc6-062d6cb7c7d3 req-d316dded-b199-4b02-9d93-b685a16b7161 service nova] Creating event network-vif-plugged:fd88804d-f436-4656-89b3-22638cb26897 for instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd on user Apr 14 17:19:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-13d917fa-aac2-427d-9cc6-062d6cb7c7d3 req-d316dded-b199-4b02-9d93-b685a16b7161 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037022 Apr 14 17:19:58 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 239/725] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:19:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:19:58 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-02b34dee-05fb-491a-b70a-7203d93e7e98 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/action" status: 202 len: 0 microversion: 2.1 time: 0.126592 Apr 14 17:19:58 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 245/726] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:19:58 2023] POST /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:19:58 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-f172cad5-d61f-4daf-934b-9d651cd21b6d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:19:58 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-f172cad5-d61f-4daf-934b-9d651cd21b6d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:19:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f172cad5-d61f-4daf-934b-9d651cd21b6d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f172cad5-d61f-4daf-934b-9d651cd21b6d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f172cad5-d61f-4daf-934b-9d651cd21b6d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f172cad5-d61f-4daf-934b-9d651cd21b6d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:19:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f172cad5-d61f-4daf-934b-9d651cd21b6d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:19:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f172cad5-d61f-4daf-934b-9d651cd21b6d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:19:59 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-f172cad5-d61f-4daf-934b-9d651cd21b6d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:19:59 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-f172cad5-d61f-4daf-934b-9d651cd21b6d tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" status: 200 len: 1739 microversion: 2.1 time: 0.253006 Apr 14 17:19:59 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 243/727] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:19:58 2023] GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:20:02 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-2d58a67d-7c80-456b-9590-ea3249210d0c req-87f3764b-3077-4126-9ba9-f3e8680fbcc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715", "name": "network-vif-unplugged", "status": "completed", "tag": "43e76338-e6dd-456e-b1e2-d2f7c150f14d"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:20:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-2d58a67d-7c80-456b-9590-ea3249210d0c req-87f3764b-3077-4126-9ba9-f3e8680fbcc2 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-2d58a67d-7c80-456b-9590-ea3249210d0c req-87f3764b-3077-4126-9ba9-f3e8680fbcc2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-2d58a67d-7c80-456b-9590-ea3249210d0c req-87f3764b-3077-4126-9ba9-f3e8680fbcc2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:02 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-2d58a67d-7c80-456b-9590-ea3249210d0c req-87f3764b-3077-4126-9ba9-f3e8680fbcc2 service nova] Creating event network-vif-unplugged:43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 on user Apr 14 17:20:02 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-2d58a67d-7c80-456b-9590-ea3249210d0c req-87f3764b-3077-4126-9ba9-f3e8680fbcc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048931 Apr 14 17:20:02 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 240/728] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:20:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:20:04 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715", "name": "network-vif-plugged", "status": "completed", "tag": "43e76338-e6dd-456e-b1e2-d2f7c150f14d"}, {"server_uuid": "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715", "name": "network-vif-plugged", "status": "completed", "tag": "43e76338-e6dd-456e-b1e2-d2f7c150f14d"}, {"server_uuid": "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715", "name": "network-vif-plugged", "status": "completed", "tag": "43e76338-e6dd-456e-b1e2-d2f7c150f14d"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:20:05 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=15 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:20:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:05 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:20:05 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] Creating event network-vif-plugged:43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 on user Apr 14 17:20:05 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] Creating event network-vif-plugged:43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 on user Apr 14 17:20:05 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] Creating event network-vif-plugged:43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 on user Apr 14 17:20:05 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-60537a9d-01bc-45f3-8cce-175549a86371 req-195050cf-b812-4c5c-89ee-4d98bcfdeca7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.033610 Apr 14 17:20:05 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 246/729] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:20:04 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:20:09 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-589dfeeb-200f-4977-8ff5-280ad59e4794 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:20:09 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-589dfeeb-200f-4977-8ff5-280ad59e4794 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:20:09 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=11 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:20:09 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:20:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-589dfeeb-200f-4977-8ff5-280ad59e4794 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-589dfeeb-200f-4977-8ff5-280ad59e4794 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-589dfeeb-200f-4977-8ff5-280ad59e4794 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-589dfeeb-200f-4977-8ff5-280ad59e4794 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-589dfeeb-200f-4977-8ff5-280ad59e4794 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-589dfeeb-200f-4977-8ff5-280ad59e4794 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:09 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-589dfeeb-200f-4977-8ff5-280ad59e4794 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:20:10 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-589dfeeb-200f-4977-8ff5-280ad59e4794 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c" status: 200 len: 1551 microversion: 2.1 time: 0.538919 Apr 14 17:20:10 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 244/730] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:20:09 2023] GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c => generated 1551 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:20:10 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-33e035f9-cd43-4696-bd8f-2fcdd309ee74 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Action: 'create', calling method: .version_select at 0x7fe19cdb3520>, body: {"keypair": {"name": "tempest-TestStampPattern-1893968129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1TLgTmcJRCf0NV6e5gbw15ylSFZ2grGTl93hoSgsD7c3k8CBt8DrEdsRWRqAmuzu773cG42HtzA2AZv4swM87k5N2kr4S4+H72RynRdtPOHPARGcjMGWd8eSzhirVuKA=="}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:20:10 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-33e035f9-cd43-4696-bd8f-2fcdd309ee74 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Getting quotas for project f7ab08f97dd54832a7cc975934b1b69f. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:20:10 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-33e035f9-cd43-4696-bd8f-2fcdd309ee74 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Getting quotas for user b8ea39d187c842788168909de203455e and project f7ab08f97dd54832a7cc975934b1b69f. Resources: {'key_pairs'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:20:10 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-33e035f9-cd43-4696-bd8f-2fcdd309ee74 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.234927 Apr 14 17:20:10 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 241/731] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 17:20:10 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:20:11 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-f97fd178-99e9-4f52-9eda-fad7329fd003 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:20:11 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-f97fd178-99e9-4f52-9eda-fad7329fd003 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:20:11 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f97fd178-99e9-4f52-9eda-fad7329fd003 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:11 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f97fd178-99e9-4f52-9eda-fad7329fd003 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:11 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f97fd178-99e9-4f52-9eda-fad7329fd003 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:11 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f97fd178-99e9-4f52-9eda-fad7329fd003 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:11 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f97fd178-99e9-4f52-9eda-fad7329fd003 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:11 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f97fd178-99e9-4f52-9eda-fad7329fd003 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:11 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-f97fd178-99e9-4f52-9eda-fad7329fd003 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:20:11 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-f97fd178-99e9-4f52-9eda-fad7329fd003 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:20:11 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-f97fd178-99e9-4f52-9eda-fad7329fd003 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:20:11 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-f97fd178-99e9-4f52-9eda-fad7329fd003 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" status: 200 len: 1768 microversion: 2.87 time: 0.320418 Apr 14 17:20:11 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 247/732] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:20:11 2023] GET /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 => generated 1768 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 17:20:14 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1834940939", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1893968129", "security_groups": [{"name": "tempest-secgroup-smoke-846815827"}], "networks": [{"uuid": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b"}]}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:20:14 user devstack@n-api.service[61934]: DEBUG nova.network.neutron [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] validate_networks() for [('f910e955-f75a-46aa-8d8a-ef2c21f4e98b', None, None, None, None, None)] {{(pid=61934) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:20:15 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:20:15 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:20:15 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:20:15 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:20:15 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:20:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:15 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Getting quotas for project f7ab08f97dd54832a7cc975934b1b69f. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:20:15 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Getting quotas for user b8ea39d187c842788168909de203455e and project f7ab08f97dd54832a7cc975934b1b69f. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:20:15 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Going to run 1 instances... {{(pid=61934) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:20:15 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:20:15 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-17b62f49-0ea3-45ba-9a1f-26e51f853987 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.750416 Apr 14 17:20:15 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 245/733] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:20:14 2023] POST /compute/v2.1/servers => generated 403 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:20:15 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:20:15 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-bc7df547-9d38-4ec1-a104-133aed1c5360 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:20:15 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-bc7df547-9d38-4ec1-a104-133aed1c5360 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:20:15 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-bc7df547-9d38-4ec1-a104-133aed1c5360 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ea39d187c842788168909de203455e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ab08f97dd54832a7cc975934b1b69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:20:15 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-bc7df547-9d38-4ec1-a104-133aed1c5360 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682" status: 200 len: 1237 microversion: 2.1 time: 0.076273 Apr 14 17:20:15 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 242/734] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:20:15 2023] GET /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682 => generated 1237 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:20:18 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-db8bb16c-5814-4822-8a20-bd6bfa71d0e2 req-305e606c-4d35-4f8e-a167-7e8452067305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a48598-5e5d-450b-a6c5-d7637a6d8682", "tag": "4e3c902c-c5f1-4842-8338-fc701ab2e11a"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:20:18 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-db8bb16c-5814-4822-8a20-bd6bfa71d0e2 req-305e606c-4d35-4f8e-a167-7e8452067305 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:18 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-db8bb16c-5814-4822-8a20-bd6bfa71d0e2 req-305e606c-4d35-4f8e-a167-7e8452067305 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:18 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-db8bb16c-5814-4822-8a20-bd6bfa71d0e2 req-305e606c-4d35-4f8e-a167-7e8452067305 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:18 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-db8bb16c-5814-4822-8a20-bd6bfa71d0e2 req-305e606c-4d35-4f8e-a167-7e8452067305 service nova] Creating event network-changed:4e3c902c-c5f1-4842-8338-fc701ab2e11a for instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 on user Apr 14 17:20:18 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-db8bb16c-5814-4822-8a20-bd6bfa71d0e2 req-305e606c-4d35-4f8e-a167-7e8452067305 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031917 Apr 14 17:20:18 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 248/735] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:20:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:20:20 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-f8608f0c-c3f9-4fc0-bbf1-0dda2bbb6d4b req-b3a8fd91-2afd-4877-ba59-776816fc9e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a48598-5e5d-450b-a6c5-d7637a6d8682", "name": "network-vif-plugged", "status": "completed", "tag": "4e3c902c-c5f1-4842-8338-fc701ab2e11a"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:20:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-f8608f0c-c3f9-4fc0-bbf1-0dda2bbb6d4b req-b3a8fd91-2afd-4877-ba59-776816fc9e21 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-f8608f0c-c3f9-4fc0-bbf1-0dda2bbb6d4b req-b3a8fd91-2afd-4877-ba59-776816fc9e21 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-f8608f0c-c3f9-4fc0-bbf1-0dda2bbb6d4b req-b3a8fd91-2afd-4877-ba59-776816fc9e21 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:20 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-f8608f0c-c3f9-4fc0-bbf1-0dda2bbb6d4b req-b3a8fd91-2afd-4877-ba59-776816fc9e21 service nova] Creating event network-vif-plugged:4e3c902c-c5f1-4842-8338-fc701ab2e11a for instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 on user Apr 14 17:20:20 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-f8608f0c-c3f9-4fc0-bbf1-0dda2bbb6d4b req-b3a8fd91-2afd-4877-ba59-776816fc9e21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031345 Apr 14 17:20:20 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 246/736] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:20:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:20:22 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-5dc89f9c-9284-43d8-b2ec-29c9a041af83 req-93a802fa-468e-4d1f-8964-6c3521929d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a48598-5e5d-450b-a6c5-d7637a6d8682", "name": "network-vif-plugged", "status": "completed", "tag": "4e3c902c-c5f1-4842-8338-fc701ab2e11a"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:20:22 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:20:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-5dc89f9c-9284-43d8-b2ec-29c9a041af83 req-93a802fa-468e-4d1f-8964-6c3521929d22 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-5dc89f9c-9284-43d8-b2ec-29c9a041af83 req-93a802fa-468e-4d1f-8964-6c3521929d22 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-5dc89f9c-9284-43d8-b2ec-29c9a041af83 req-93a802fa-468e-4d1f-8964-6c3521929d22 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:22 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-5dc89f9c-9284-43d8-b2ec-29c9a041af83 req-93a802fa-468e-4d1f-8964-6c3521929d22 service nova] Creating event network-vif-plugged:4e3c902c-c5f1-4842-8338-fc701ab2e11a for instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 on user Apr 14 17:20:22 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-5dc89f9c-9284-43d8-b2ec-29c9a041af83 req-93a802fa-468e-4d1f-8964-6c3521929d22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032501 Apr 14 17:20:22 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 243/737] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:20:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:20:37 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=7 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:20:37 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=9 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:20:37 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-4b540b76-dce1-43fc-b15d-3c56c059ae22 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:20:37 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-4b540b76-dce1-43fc-b15d-3c56c059ae22 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:20:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4b540b76-dce1-43fc-b15d-3c56c059ae22 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4b540b76-dce1-43fc-b15d-3c56c059ae22 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4b540b76-dce1-43fc-b15d-3c56c059ae22 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4b540b76-dce1-43fc-b15d-3c56c059ae22 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4b540b76-dce1-43fc-b15d-3c56c059ae22 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4b540b76-dce1-43fc-b15d-3c56c059ae22 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:37 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-4b540b76-dce1-43fc-b15d-3c56c059ae22 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:20:37 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-4b540b76-dce1-43fc-b15d-3c56c059ae22 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:20:37 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-4b540b76-dce1-43fc-b15d-3c56c059ae22 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:20:37 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-4b540b76-dce1-43fc-b15d-3c56c059ae22 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd" status: 200 len: 1706 microversion: 2.20 time: 0.308818 Apr 14 17:20:37 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 249/738] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:20:37 2023] GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd => generated 1706 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:20:41 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:20:41 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:20:41 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:20:41 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=10 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:20:41 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-14233cbf-9943-4c56-aa36-4ba1714143ce tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Action: 'create', calling method: .version_select at 0x7fe19cef4940>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1467007685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME8aoJyi0vLQ0MCxGXeBzoEE4eLG4CfEQiz1k6/xiDjKOq15pBqG+t7b9GfO5oOEKJaRgYDThOzcI9kcGOzCkBEuKkYPt0LUpXKhM6Yh6bYcd6WF1/PXpn6j5rcw/py5A=="}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:20:41 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-14233cbf-9943-4c56-aa36-4ba1714143ce tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Getting quotas for project 5e3e0c3b9c7b4ca79b75def0f04f5549. Resources: {'key_pairs'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:20:41 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-14233cbf-9943-4c56-aa36-4ba1714143ce tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Getting quotas for user ecae496b720c4e09b90986969d9ae9fa and project 5e3e0c3b9c7b4ca79b75def0f04f5549. Resources: {'key_pairs'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:20:41 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-14233cbf-9943-4c56-aa36-4ba1714143ce tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.266751 Apr 14 17:20:41 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 247/739] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 17:20:41 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-880884795", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1467007685", "security_groups": [{"name": "tempest-secgroup-smoke-1627601444"}], "networks": [{"uuid": "992312a0-f518-430d-b27d-32c995b50f8c"}]}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG nova.network.neutron [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] validate_networks() for [('992312a0-f518-430d-b27d-32c995b50f8c', None, None, None, None, None)] {{(pid=61933) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Flavor limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Image limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Flavor pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Image pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Getting quotas for project 5e3e0c3b9c7b4ca79b75def0f04f5549. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Getting quotas for user ecae496b720c4e09b90986969d9ae9fa and project 5e3e0c3b9c7b4ca79b75def0f04f5549. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Going to run 1 instances... {{(pid=61933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:20:43 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:20:43 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-9c4e877f-3872-42ee-bfab-9cbfc3d9e4fe tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.603470 Apr 14 17:20:43 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 244/740] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:20:43 2023] POST /compute/v2.1/servers => generated 404 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:20:43 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-395bf756-eafc-46e3-a3a9-d0db620896f5 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:20:43 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-395bf756-eafc-46e3-a3a9-d0db620896f5 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:20:43 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-395bf756-eafc-46e3-a3a9-d0db620896f5 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecae496b720c4e09b90986969d9ae9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3e0c3b9c7b4ca79b75def0f04f5549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:20:43 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-395bf756-eafc-46e3-a3a9-d0db620896f5 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b" status: 200 len: 1256 microversion: 2.1 time: 0.086768 Apr 14 17:20:43 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 250/741] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:20:43 2023] GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b => generated 1256 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:20:46 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-b5d732fd-968f-4a6c-8150-190b7a40587e req-b7758dd7-d92a-4fa9-b920-30350e6d4e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ce59e7-b263-4e0b-9f19-638db9606c7b", "tag": "7549a60b-8755-4baa-bf6b-6571c0cbb88b"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:20:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b5d732fd-968f-4a6c-8150-190b7a40587e req-b7758dd7-d92a-4fa9-b920-30350e6d4e4c service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b5d732fd-968f-4a6c-8150-190b7a40587e req-b7758dd7-d92a-4fa9-b920-30350e6d4e4c service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b5d732fd-968f-4a6c-8150-190b7a40587e req-b7758dd7-d92a-4fa9-b920-30350e6d4e4c service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:46 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-b5d732fd-968f-4a6c-8150-190b7a40587e req-b7758dd7-d92a-4fa9-b920-30350e6d4e4c service nova] Creating event network-changed:7549a60b-8755-4baa-bf6b-6571c0cbb88b for instance 15ce59e7-b263-4e0b-9f19-638db9606c7b on user Apr 14 17:20:46 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-b5d732fd-968f-4a6c-8150-190b7a40587e req-b7758dd7-d92a-4fa9-b920-30350e6d4e4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041548 Apr 14 17:20:46 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 248/742] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:20:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:20:47 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-3ea2490d-363d-42a0-9bd4-1cfab24cf893 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:20:47 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-3ea2490d-363d-42a0-9bd4-1cfab24cf893 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:20:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3ea2490d-363d-42a0-9bd4-1cfab24cf893 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3ea2490d-363d-42a0-9bd4-1cfab24cf893 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3ea2490d-363d-42a0-9bd4-1cfab24cf893 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3ea2490d-363d-42a0-9bd4-1cfab24cf893 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3ea2490d-363d-42a0-9bd4-1cfab24cf893 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3ea2490d-363d-42a0-9bd4-1cfab24cf893 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:48 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:20:48 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-0c5a7fda-391e-4d44-bb7b-6c9f2ca64033 req-8e8933bf-268d-4057-93ea-44f03d39818a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ce59e7-b263-4e0b-9f19-638db9606c7b", "name": "network-vif-plugged", "status": "completed", "tag": "7549a60b-8755-4baa-bf6b-6571c0cbb88b"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:20:48 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-0c5a7fda-391e-4d44-bb7b-6c9f2ca64033 req-8e8933bf-268d-4057-93ea-44f03d39818a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:48 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-0c5a7fda-391e-4d44-bb7b-6c9f2ca64033 req-8e8933bf-268d-4057-93ea-44f03d39818a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:48 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-0c5a7fda-391e-4d44-bb7b-6c9f2ca64033 req-8e8933bf-268d-4057-93ea-44f03d39818a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:48 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-3ea2490d-363d-42a0-9bd4-1cfab24cf893 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:20:48 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-3ea2490d-363d-42a0-9bd4-1cfab24cf893 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1721 microversion: 2.1 time: 0.248970 Apr 14 17:20:48 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 245/743] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:20:47 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:20:48 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-0c5a7fda-391e-4d44-bb7b-6c9f2ca64033 req-8e8933bf-268d-4057-93ea-44f03d39818a service nova] Creating event network-vif-plugged:7549a60b-8755-4baa-bf6b-6571c0cbb88b for instance 15ce59e7-b263-4e0b-9f19-638db9606c7b on user Apr 14 17:20:48 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-0c5a7fda-391e-4d44-bb7b-6c9f2ca64033 req-8e8933bf-268d-4057-93ea-44f03d39818a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040961 Apr 14 17:20:48 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 251/744] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:20:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:20:48 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-059464d3-0d20-47bc-9a9a-d6fb5908328e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:20:48 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-059464d3-0d20-47bc-9a9a-d6fb5908328e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:20:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-059464d3-0d20-47bc-9a9a-d6fb5908328e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-059464d3-0d20-47bc-9a9a-d6fb5908328e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-059464d3-0d20-47bc-9a9a-d6fb5908328e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-059464d3-0d20-47bc-9a9a-d6fb5908328e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-059464d3-0d20-47bc-9a9a-d6fb5908328e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-059464d3-0d20-47bc-9a9a-d6fb5908328e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:48 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-059464d3-0d20-47bc-9a9a-d6fb5908328e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:20:48 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-059464d3-0d20-47bc-9a9a-d6fb5908328e tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1721 microversion: 2.1 time: 0.253585 Apr 14 17:20:48 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 249/745] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:20:48 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:20:49 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-3adab07a-70ea-41fc-88f6-2c53f8419147 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:20:49 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-3adab07a-70ea-41fc-88f6-2c53f8419147 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:20:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3adab07a-70ea-41fc-88f6-2c53f8419147 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3adab07a-70ea-41fc-88f6-2c53f8419147 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3adab07a-70ea-41fc-88f6-2c53f8419147 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3adab07a-70ea-41fc-88f6-2c53f8419147 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3adab07a-70ea-41fc-88f6-2c53f8419147 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:49 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3adab07a-70ea-41fc-88f6-2c53f8419147 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:49 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-3adab07a-70ea-41fc-88f6-2c53f8419147 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:20:49 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-3adab07a-70ea-41fc-88f6-2c53f8419147 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" status: 200 len: 1747 microversion: 2.1 time: 0.517853 Apr 14 17:20:49 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 246/746] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:20:49 2023] GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 => generated 1747 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:20:50 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-8630fdb7-e1ad-43ce-aae0-6216757f980d req-1a1cb65d-482c-4f59-b069-a386eb012f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ce59e7-b263-4e0b-9f19-638db9606c7b", "name": "network-vif-plugged", "status": "completed", "tag": "7549a60b-8755-4baa-bf6b-6571c0cbb88b"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:20:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8630fdb7-e1ad-43ce-aae0-6216757f980d req-1a1cb65d-482c-4f59-b069-a386eb012f66 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:20:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8630fdb7-e1ad-43ce-aae0-6216757f980d req-1a1cb65d-482c-4f59-b069-a386eb012f66 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:20:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-8630fdb7-e1ad-43ce-aae0-6216757f980d req-1a1cb65d-482c-4f59-b069-a386eb012f66 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:20:50 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-8630fdb7-e1ad-43ce-aae0-6216757f980d req-1a1cb65d-482c-4f59-b069-a386eb012f66 service nova] Creating event network-vif-plugged:7549a60b-8755-4baa-bf6b-6571c0cbb88b for instance 15ce59e7-b263-4e0b-9f19-638db9606c7b on user Apr 14 17:20:50 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-8630fdb7-e1ad-43ce-aae0-6216757f980d req-1a1cb65d-482c-4f59-b069-a386eb012f66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054099 Apr 14 17:20:50 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 252/747] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:20:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:21:05 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-f1b7edbf-1659-4604-a4dc-d2ad7880984f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:21:05 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-f1b7edbf-1659-4604-a4dc-d2ad7880984f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:21:05 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:21:05 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:21:05 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=8 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:21:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f1b7edbf-1659-4604-a4dc-d2ad7880984f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f1b7edbf-1659-4604-a4dc-d2ad7880984f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f1b7edbf-1659-4604-a4dc-d2ad7880984f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f1b7edbf-1659-4604-a4dc-d2ad7880984f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f1b7edbf-1659-4604-a4dc-d2ad7880984f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f1b7edbf-1659-4604-a4dc-d2ad7880984f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:05 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-f1b7edbf-1659-4604-a4dc-d2ad7880984f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ea39d187c842788168909de203455e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ab08f97dd54832a7cc975934b1b69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:21:05 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-f1b7edbf-1659-4604-a4dc-d2ad7880984f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682" status: 200 len: 1538 microversion: 2.1 time: 0.330162 Apr 14 17:21:05 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 250/748] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:21:05 2023] GET /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682 => generated 1538 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:21:10 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-89bdc540-f615-490f-820d-77459a9b83e4 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:21:10 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-89bdc540-f615-490f-820d-77459a9b83e4 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:21:10 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:21:10 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:21:10 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:21:10 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=14 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:21:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-89bdc540-f615-490f-820d-77459a9b83e4 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-89bdc540-f615-490f-820d-77459a9b83e4 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-89bdc540-f615-490f-820d-77459a9b83e4 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-89bdc540-f615-490f-820d-77459a9b83e4 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-89bdc540-f615-490f-820d-77459a9b83e4 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-89bdc540-f615-490f-820d-77459a9b83e4 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:10 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-89bdc540-f615-490f-820d-77459a9b83e4 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.236150 Apr 14 17:21:10 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 247/749] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 17:21:10 2023] GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/os-interface => generated 282 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:21:11 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:21:11 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=10 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:21:11 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:21:11 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-2919b97f-63a6-4cea-8e8e-3a7a1e8b6c6d req-0d4ba856-ba07-42bf-86f8-e3c7f7eaac27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:11 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2919b97f-63a6-4cea-8e8e-3a7a1e8b6c6d req-0d4ba856-ba07-42bf-86f8-e3c7f7eaac27 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:11 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2919b97f-63a6-4cea-8e8e-3a7a1e8b6c6d req-0d4ba856-ba07-42bf-86f8-e3c7f7eaac27 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:11 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2919b97f-63a6-4cea-8e8e-3a7a1e8b6c6d req-0d4ba856-ba07-42bf-86f8-e3c7f7eaac27 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:11 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-2919b97f-63a6-4cea-8e8e-3a7a1e8b6c6d req-0d4ba856-ba07-42bf-86f8-e3c7f7eaac27 service nova] Creating event network-changed:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:21:11 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-2919b97f-63a6-4cea-8e8e-3a7a1e8b6c6d req-0d4ba856-ba07-42bf-86f8-e3c7f7eaac27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040450 Apr 14 17:21:11 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 253/750] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:21:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:21:11 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5380e47e-86ce-482e-b6d7-b756348399d5"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:11 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:21:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:11 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-1b806211-6582-4f08-b3c1-2a806a3fbf09 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280136 Apr 14 17:21:11 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 251/751] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:21:11 2023] POST /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:21:11 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "9ee807dd-e685-47e5-93fb-e53deedeac4c"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:11 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:21:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:11 user devstack@n-api.service[61933]: DEBUG nova.objects.instance [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lazy-loading 'flavor' on Instance uuid 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 {{(pid=61933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:21:12 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-72df4403-2434-4fd1-81fe-488be5288ed0 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/action" status: 200 len: 29 microversion: 2.87 time: 0.419038 Apr 14 17:21:12 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 248/752] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 17:21:11 2023] POST /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/action => generated 29 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:21:12 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-27838ae7-1939-4d19-81cf-82b6fa81a4f8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:21:12 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-27838ae7-1939-4d19-81cf-82b6fa81a4f8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:21:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-27838ae7-1939-4d19-81cf-82b6fa81a4f8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-27838ae7-1939-4d19-81cf-82b6fa81a4f8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-27838ae7-1939-4d19-81cf-82b6fa81a4f8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-27838ae7-1939-4d19-81cf-82b6fa81a4f8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-27838ae7-1939-4d19-81cf-82b6fa81a4f8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-27838ae7-1939-4d19-81cf-82b6fa81a4f8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:12 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-27838ae7-1939-4d19-81cf-82b6fa81a4f8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:21:12 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-27838ae7-1939-4d19-81cf-82b6fa81a4f8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:21:12 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-27838ae7-1939-4d19-81cf-82b6fa81a4f8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:21:12 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-27838ae7-1939-4d19-81cf-82b6fa81a4f8 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" status: 200 len: 1774 microversion: 2.87 time: 0.328593 Apr 14 17:21:12 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 254/753] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:21:12 2023] GET /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 => generated 1774 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:21:13 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-c61cb584-2ee9-4ad6-8575-1aca18dcb85b req-0962dbbf-8d04-4664-bd40-a130fd2053cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3", "name": "network-vif-unplugged", "status": "completed", "tag": "9262ab81-5611-4d5e-b32b-082b3c4981fd"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-c61cb584-2ee9-4ad6-8575-1aca18dcb85b req-0962dbbf-8d04-4664-bd40-a130fd2053cc service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-c61cb584-2ee9-4ad6-8575-1aca18dcb85b req-0962dbbf-8d04-4664-bd40-a130fd2053cc service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-c61cb584-2ee9-4ad6-8575-1aca18dcb85b req-0962dbbf-8d04-4664-bd40-a130fd2053cc service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:13 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-c61cb584-2ee9-4ad6-8575-1aca18dcb85b req-0962dbbf-8d04-4664-bd40-a130fd2053cc service nova] Creating event network-vif-unplugged:9262ab81-5611-4d5e-b32b-082b3c4981fd for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 on user Apr 14 17:21:13 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-c61cb584-2ee9-4ad6-8575-1aca18dcb85b req-0962dbbf-8d04-4664-bd40-a130fd2053cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044328 Apr 14 17:21:13 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 252/754] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:21:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:21:15 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-c4131fa7-2ab3-4fc9-bd36-e179f9eafd85 req-1990b057-2173-4e4d-8fdf-67430f4ac002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3", "name": "network-vif-plugged", "status": "completed", "tag": "9262ab81-5611-4d5e-b32b-082b3c4981fd"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:15 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c4131fa7-2ab3-4fc9-bd36-e179f9eafd85 req-1990b057-2173-4e4d-8fdf-67430f4ac002 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:15 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c4131fa7-2ab3-4fc9-bd36-e179f9eafd85 req-1990b057-2173-4e4d-8fdf-67430f4ac002 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:15 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c4131fa7-2ab3-4fc9-bd36-e179f9eafd85 req-1990b057-2173-4e4d-8fdf-67430f4ac002 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:15 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-c4131fa7-2ab3-4fc9-bd36-e179f9eafd85 req-1990b057-2173-4e4d-8fdf-67430f4ac002 service nova] Creating event network-vif-plugged:9262ab81-5611-4d5e-b32b-082b3c4981fd for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 on user Apr 14 17:21:15 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-c4131fa7-2ab3-4fc9-bd36-e179f9eafd85 req-1990b057-2173-4e4d-8fdf-67430f4ac002 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031161 Apr 14 17:21:15 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 249/755] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:21:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:21:17 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-3fbbba36-582d-4dd1-9510-7c6c50f82f93 req-c0bd1ddb-b550-43eb-96ea-889c9d895fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3", "name": "network-vif-plugged", "status": "completed", "tag": "9262ab81-5611-4d5e-b32b-082b3c4981fd"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3fbbba36-582d-4dd1-9510-7c6c50f82f93 req-c0bd1ddb-b550-43eb-96ea-889c9d895fa4 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3fbbba36-582d-4dd1-9510-7c6c50f82f93 req-c0bd1ddb-b550-43eb-96ea-889c9d895fa4 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3fbbba36-582d-4dd1-9510-7c6c50f82f93 req-c0bd1ddb-b550-43eb-96ea-889c9d895fa4 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:17 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-3fbbba36-582d-4dd1-9510-7c6c50f82f93 req-c0bd1ddb-b550-43eb-96ea-889c9d895fa4 service nova] Creating event network-vif-plugged:9262ab81-5611-4d5e-b32b-082b3c4981fd for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 on user Apr 14 17:21:17 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-3fbbba36-582d-4dd1-9510-7c6c50f82f93 req-c0bd1ddb-b550-43eb-96ea-889c9d895fa4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047989 Apr 14 17:21:17 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 255/756] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:21:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:21:19 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:19 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:21:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:19 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:19 user devstack@n-api.service[61934]: DEBUG nova.objects.instance [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'flavor' on Instance uuid 0cf7a0ce-87a0-4a24-8410-26d056e8816c {{(pid=61934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:21:19 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-4f2f5ebf-9279-4de7-9e25-097981b67015 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/action" status: 200 len: 32 microversion: 2.1 time: 0.169002 Apr 14 17:21:19 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 253/757] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:21:19 2023] POST /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:21:19 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-95682d81-6ef0-42ea-ba0d-ed1578c5ac44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:21:19 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-95682d81-6ef0-42ea-ba0d-ed1578c5ac44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:21:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-95682d81-6ef0-42ea-ba0d-ed1578c5ac44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-95682d81-6ef0-42ea-ba0d-ed1578c5ac44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-95682d81-6ef0-42ea-ba0d-ed1578c5ac44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-95682d81-6ef0-42ea-ba0d-ed1578c5ac44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-95682d81-6ef0-42ea-ba0d-ed1578c5ac44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-95682d81-6ef0-42ea-ba0d-ed1578c5ac44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:19 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-3ea6f6cc-4772-45e6-9315-867704961047 req-9188b597-3336-4bb3-bfd2-a0b64a9b7a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3", "name": "network-vif-plugged", "status": "completed", "tag": "9262ab81-5611-4d5e-b32b-082b3c4981fd"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3ea6f6cc-4772-45e6-9315-867704961047 req-9188b597-3336-4bb3-bfd2-a0b64a9b7a85 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3ea6f6cc-4772-45e6-9315-867704961047 req-9188b597-3336-4bb3-bfd2-a0b64a9b7a85 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3ea6f6cc-4772-45e6-9315-867704961047 req-9188b597-3336-4bb3-bfd2-a0b64a9b7a85 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:19 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-3ea6f6cc-4772-45e6-9315-867704961047 req-9188b597-3336-4bb3-bfd2-a0b64a9b7a85 service nova] Creating event network-vif-plugged:9262ab81-5611-4d5e-b32b-082b3c4981fd for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 on user Apr 14 17:21:19 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-3ea6f6cc-4772-45e6-9315-867704961047 req-9188b597-3336-4bb3-bfd2-a0b64a9b7a85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033443 Apr 14 17:21:19 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 256/758] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:21:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:21:19 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-95682d81-6ef0-42ea-ba0d-ed1578c5ac44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:21:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-95682d81-6ef0-42ea-ba0d-ed1578c5ac44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c" status: 200 len: 1722 microversion: 2.1 time: 0.367952 Apr 14 17:21:19 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 250/759] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:21:19 2023] GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c => generated 1722 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:21:20 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-c89977e9-55bf-40c5-ba80-f27c13600a15 req-191fab98-49c0-4299-8524-836c1641fcab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "name": "network-vif-unplugged", "status": "completed", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-c89977e9-55bf-40c5-ba80-f27c13600a15 req-191fab98-49c0-4299-8524-836c1641fcab service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-c89977e9-55bf-40c5-ba80-f27c13600a15 req-191fab98-49c0-4299-8524-836c1641fcab service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-c89977e9-55bf-40c5-ba80-f27c13600a15 req-191fab98-49c0-4299-8524-836c1641fcab service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:20 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-c89977e9-55bf-40c5-ba80-f27c13600a15 req-191fab98-49c0-4299-8524-836c1641fcab service nova] Creating event network-vif-unplugged:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:21:20 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-c89977e9-55bf-40c5-ba80-f27c13600a15 req-191fab98-49c0-4299-8524-836c1641fcab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037997 Apr 14 17:21:20 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 254/760] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:21:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:21:22 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-008241cd-0c63-4274-9dfb-1f5425b7699d req-d1e8d203-cf8f-40b3-bb62-83a0e7906895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "name": "network-vif-plugged", "status": "completed", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-008241cd-0c63-4274-9dfb-1f5425b7699d req-d1e8d203-cf8f-40b3-bb62-83a0e7906895 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-008241cd-0c63-4274-9dfb-1f5425b7699d req-d1e8d203-cf8f-40b3-bb62-83a0e7906895 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-008241cd-0c63-4274-9dfb-1f5425b7699d req-d1e8d203-cf8f-40b3-bb62-83a0e7906895 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:22 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-008241cd-0c63-4274-9dfb-1f5425b7699d req-d1e8d203-cf8f-40b3-bb62-83a0e7906895 service nova] Creating event network-vif-plugged:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:21:22 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-008241cd-0c63-4274-9dfb-1f5425b7699d req-d1e8d203-cf8f-40b3-bb62-83a0e7906895 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057610 Apr 14 17:21:22 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 257/761] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:21:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:21:24 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "name": "network-vif-plugged", "status": "completed", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}, {"server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "name": "network-vif-plugged", "status": "completed", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:24 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:24 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:24 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:24 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] Creating event network-vif-plugged:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:21:24 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] Creating event network-vif-plugged:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:21:24 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-5cbceadf-6386-4075-a478-31eca823e471 req-ae7945ad-0b94-4bc7-be9c-53337af3b7f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.377846 Apr 14 17:21:24 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 251/762] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:21:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:21:33 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-fc052c01-dfda-447e-8ee8-cb78670eae6a tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:21:33 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-fc052c01-dfda-447e-8ee8-cb78670eae6a tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:21:33 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=10 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:21:33 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:21:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fc052c01-dfda-447e-8ee8-cb78670eae6a tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fc052c01-dfda-447e-8ee8-cb78670eae6a tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fc052c01-dfda-447e-8ee8-cb78670eae6a tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fc052c01-dfda-447e-8ee8-cb78670eae6a tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fc052c01-dfda-447e-8ee8-cb78670eae6a tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fc052c01-dfda-447e-8ee8-cb78670eae6a tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:34 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-fc052c01-dfda-447e-8ee8-cb78670eae6a tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecae496b720c4e09b90986969d9ae9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3e0c3b9c7b4ca79b75def0f04f5549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:21:34 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-fc052c01-dfda-447e-8ee8-cb78670eae6a tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b" status: 200 len: 1567 microversion: 2.1 time: 0.259971 Apr 14 17:21:34 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 255/763] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:21:33 2023] GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:21:37 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=12 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:21:37 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=14 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:21:37 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-aba716bf-cb61-40b4-a28f-4a3cc777344b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:21:37 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-aba716bf-cb61-40b4-a28f-4a3cc777344b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:21:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-aba716bf-cb61-40b4-a28f-4a3cc777344b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-aba716bf-cb61-40b4-a28f-4a3cc777344b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-aba716bf-cb61-40b4-a28f-4a3cc777344b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-aba716bf-cb61-40b4-a28f-4a3cc777344b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-aba716bf-cb61-40b4-a28f-4a3cc777344b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:37 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-aba716bf-cb61-40b4-a28f-4a3cc777344b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:38 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-aba716bf-cb61-40b4-a28f-4a3cc777344b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060141 Apr 14 17:21:38 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 258/764] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 17:21:37 2023] GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:21:38 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=10 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:21:38 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:21:38 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:21:38 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:21:38 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:38 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:38 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:38 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:38 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:38 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:38 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Going to try to terminate instance {{(pid=61933) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:21:38 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-6a0ad3f3-9877-452f-bddc-8260ad5be3d2 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd" status: 204 len: 0 microversion: 2.20 time: 0.163813 Apr 14 17:21:38 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 252/765] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 17:21:38 2023] DELETE /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 17:21:38 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-c4c02e82-498f-41c0-85c7-af7520125293 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:21:38 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-c4c02e82-498f-41c0-85c7-af7520125293 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:21:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c4c02e82-498f-41c0-85c7-af7520125293 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c4c02e82-498f-41c0-85c7-af7520125293 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c4c02e82-498f-41c0-85c7-af7520125293 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c4c02e82-498f-41c0-85c7-af7520125293 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c4c02e82-498f-41c0-85c7-af7520125293 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c4c02e82-498f-41c0-85c7-af7520125293 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:38 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-40de8591-f565-434b-be80-ac2ab182d931 req-502a5e87-f04c-45cc-9880-eeb0fbeccbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49931fa3-281e-43d0-a3e9-fde8f502b2cd", "name": "network-vif-unplugged", "status": "completed", "tag": "fd88804d-f436-4656-89b3-22638cb26897"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-40de8591-f565-434b-be80-ac2ab182d931 req-502a5e87-f04c-45cc-9880-eeb0fbeccbe6 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-40de8591-f565-434b-be80-ac2ab182d931 req-502a5e87-f04c-45cc-9880-eeb0fbeccbe6 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-40de8591-f565-434b-be80-ac2ab182d931 req-502a5e87-f04c-45cc-9880-eeb0fbeccbe6 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:38 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-c4c02e82-498f-41c0-85c7-af7520125293 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:21:38 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-40de8591-f565-434b-be80-ac2ab182d931 req-502a5e87-f04c-45cc-9880-eeb0fbeccbe6 service nova] Creating event network-vif-unplugged:fd88804d-f436-4656-89b3-22638cb26897 for instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd on user Apr 14 17:21:38 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-40de8591-f565-434b-be80-ac2ab182d931 req-502a5e87-f04c-45cc-9880-eeb0fbeccbe6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041064 Apr 14 17:21:38 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 259/766] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:21:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:21:38 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-c4c02e82-498f-41c0-85c7-af7520125293 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:21:38 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-c4c02e82-498f-41c0-85c7-af7520125293 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6aa926d6cfc94b08a564404f95da5483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae1b41823a64cd0b1c1a1669ad202ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:21:38 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-c4c02e82-498f-41c0-85c7-af7520125293 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd" status: 200 len: 1712 microversion: 2.20 time: 0.309537 Apr 14 17:21:38 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 256/767] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:21:38 2023] GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd => generated 1712 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:21:39 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-03747c07-1394-44c7-9e7a-0e28f5c6160a req-bdf099df-7892-4bef-802c-000626eb72a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49931fa3-281e-43d0-a3e9-fde8f502b2cd", "name": "network-vif-deleted", "tag": "fd88804d-f436-4656-89b3-22638cb26897"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-03747c07-1394-44c7-9e7a-0e28f5c6160a req-bdf099df-7892-4bef-802c-000626eb72a8 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-03747c07-1394-44c7-9e7a-0e28f5c6160a req-bdf099df-7892-4bef-802c-000626eb72a8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-03747c07-1394-44c7-9e7a-0e28f5c6160a req-bdf099df-7892-4bef-802c-000626eb72a8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-03747c07-1394-44c7-9e7a-0e28f5c6160a req-bdf099df-7892-4bef-802c-000626eb72a8 service nova] Creating event network-vif-deleted:fd88804d-f436-4656-89b3-22638cb26897 for instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd on user Apr 14 17:21:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-03747c07-1394-44c7-9e7a-0e28f5c6160a req-bdf099df-7892-4bef-802c-000626eb72a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035725 Apr 14 17:21:39 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 253/768] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:21:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:21:40 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-9e79d173-efd9-4078-8c2a-6ed57e5b7ca2 req-197e3f2c-2e3f-4402-a329-ffd197e0aad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49931fa3-281e-43d0-a3e9-fde8f502b2cd", "name": "network-vif-plugged", "status": "completed", "tag": "fd88804d-f436-4656-89b3-22638cb26897"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-9e79d173-efd9-4078-8c2a-6ed57e5b7ca2 req-197e3f2c-2e3f-4402-a329-ffd197e0aad6 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-9e79d173-efd9-4078-8c2a-6ed57e5b7ca2 req-197e3f2c-2e3f-4402-a329-ffd197e0aad6 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-9e79d173-efd9-4078-8c2a-6ed57e5b7ca2 req-197e3f2c-2e3f-4402-a329-ffd197e0aad6 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:40 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-9e79d173-efd9-4078-8c2a-6ed57e5b7ca2 req-197e3f2c-2e3f-4402-a329-ffd197e0aad6 service nova] Creating event network-vif-plugged:fd88804d-f436-4656-89b3-22638cb26897 for instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd on user Apr 14 17:21:40 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-9e79d173-efd9-4078-8c2a-6ed57e5b7ca2 req-197e3f2c-2e3f-4402-a329-ffd197e0aad6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029885 Apr 14 17:21:40 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 260/769] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:21:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:21:48 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:21:48 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:21:48 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:21:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:48 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Going to try to terminate instance {{(pid=61934) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:21:48 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-43947449-137d-40b1-b02c-b49079bef0ab tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 204 len: 0 microversion: 2.1 time: 0.127824 Apr 14 17:21:48 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 257/770] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:21:48 2023] DELETE /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:21:48 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-264e769a-ca84-45fc-9527-291280095c81 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:21:48 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-264e769a-ca84-45fc-9527-291280095c81 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:21:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-264e769a-ca84-45fc-9527-291280095c81 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-264e769a-ca84-45fc-9527-291280095c81 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-264e769a-ca84-45fc-9527-291280095c81 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-264e769a-ca84-45fc-9527-291280095c81 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-264e769a-ca84-45fc-9527-291280095c81 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:48 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-264e769a-ca84-45fc-9527-291280095c81 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:48 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-264e769a-ca84-45fc-9527-291280095c81 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:21:48 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-264e769a-ca84-45fc-9527-291280095c81 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 200 len: 1727 microversion: 2.1 time: 0.330034 Apr 14 17:21:48 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 254/771] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:21:48 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 1727 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:21:48 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-36e0077a-f93a-499d-8020-6ca435a422d8 req-d3b5d2a1-bb58-4593-bf38-cb3b30e25fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "name": "network-vif-unplugged", "status": "completed", "tag": "de268504-352a-4d08-8113-a2098b794478"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:48 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-36e0077a-f93a-499d-8020-6ca435a422d8 req-d3b5d2a1-bb58-4593-bf38-cb3b30e25fb7 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:48 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-36e0077a-f93a-499d-8020-6ca435a422d8 req-d3b5d2a1-bb58-4593-bf38-cb3b30e25fb7 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:48 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-36e0077a-f93a-499d-8020-6ca435a422d8 req-d3b5d2a1-bb58-4593-bf38-cb3b30e25fb7 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:48 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-36e0077a-f93a-499d-8020-6ca435a422d8 req-d3b5d2a1-bb58-4593-bf38-cb3b30e25fb7 service nova] Creating event network-vif-unplugged:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:21:48 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-36e0077a-f93a-499d-8020-6ca435a422d8 req-d3b5d2a1-bb58-4593-bf38-cb3b30e25fb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033156 Apr 14 17:21:48 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 261/772] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:21:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:21:50 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-e23b79d3-b706-4183-ae4f-b85bd2b7c2f8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1357679669"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:50 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-e23b79d3-b706-4183-ae4f-b85bd2b7c2f8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:21:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e23b79d3-b706-4183-ae4f-b85bd2b7c2f8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e23b79d3-b706-4183-ae4f-b85bd2b7c2f8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e23b79d3-b706-4183-ae4f-b85bd2b7c2f8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e23b79d3-b706-4183-ae4f-b85bd2b7c2f8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e23b79d3-b706-4183-ae4f-b85bd2b7c2f8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:50 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e23b79d3-b706-4183-ae4f-b85bd2b7c2f8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:50 user devstack@n-api.service[61934]: INFO nova.network.security_group_api [None req-e23b79d3-b706-4183-ae4f-b85bd2b7c2f8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Removing security group 182c8c3c-44db-4a1c-8ade-8aadab322972 from port 43e76338-e6dd-456e-b1e2-d2f7c150f14d Apr 14 17:21:51 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-e23b79d3-b706-4183-ae4f-b85bd2b7c2f8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/action" status: 202 len: 0 microversion: 2.1 time: 0.950507 Apr 14 17:21:51 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 258/773] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:21:50 2023] POST /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/action => generated 0 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:21:51 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-4243f3ea-4f83-4a95-8c8b-30dd4cd2378d req-b7d6076f-b767-4222-b633-d8f299b90a6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715", "tag": "43e76338-e6dd-456e-b1e2-d2f7c150f14d"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:51 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-4243f3ea-4f83-4a95-8c8b-30dd4cd2378d req-b7d6076f-b767-4222-b633-d8f299b90a6d service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:51 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-4243f3ea-4f83-4a95-8c8b-30dd4cd2378d req-b7d6076f-b767-4222-b633-d8f299b90a6d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:51 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-4243f3ea-4f83-4a95-8c8b-30dd4cd2378d req-b7d6076f-b767-4222-b633-d8f299b90a6d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:51 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-4243f3ea-4f83-4a95-8c8b-30dd4cd2378d req-b7d6076f-b767-4222-b633-d8f299b90a6d service nova] Creating event network-changed:43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 on user Apr 14 17:21:51 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-4243f3ea-4f83-4a95-8c8b-30dd4cd2378d req-b7d6076f-b767-4222-b633-d8f299b90a6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031592 Apr 14 17:21:51 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 255/774] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:21:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:21:51 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-7847d26a-0a99-4ae9-9351-b658e182cadb req-25b3bd98-f5cd-4de5-a246-c0c494a248bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "name": "network-vif-plugged", "status": "completed", "tag": "de268504-352a-4d08-8113-a2098b794478"}, {"server_uuid": "84c02556-abf7-4832-a1b2-a2c28a7f8e52", "name": "network-vif-deleted", "tag": "de268504-352a-4d08-8113-a2098b794478"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-7847d26a-0a99-4ae9-9351-b658e182cadb req-25b3bd98-f5cd-4de5-a246-c0c494a248bd service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-7847d26a-0a99-4ae9-9351-b658e182cadb req-25b3bd98-f5cd-4de5-a246-c0c494a248bd service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-7847d26a-0a99-4ae9-9351-b658e182cadb req-25b3bd98-f5cd-4de5-a246-c0c494a248bd service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:51 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-7847d26a-0a99-4ae9-9351-b658e182cadb req-25b3bd98-f5cd-4de5-a246-c0c494a248bd service nova] Creating event network-vif-plugged:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:21:51 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-7847d26a-0a99-4ae9-9351-b658e182cadb req-25b3bd98-f5cd-4de5-a246-c0c494a248bd service nova] Creating event network-vif-deleted:de268504-352a-4d08-8113-a2098b794478 for instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 on user Apr 14 17:21:51 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-7847d26a-0a99-4ae9-9351-b658e182cadb req-25b3bd98-f5cd-4de5-a246-c0c494a248bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032117 Apr 14 17:21:51 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 262/775] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:21:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:21:52 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:21:52 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:21:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:52 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-ccb8af93-560e-4444-95e2-def64c607d73 req-30d09453-7390-491a-956b-46d5dd35b727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715", "tag": "43e76338-e6dd-456e-b1e2-d2f7c150f14d"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:21:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ccb8af93-560e-4444-95e2-def64c607d73 req-30d09453-7390-491a-956b-46d5dd35b727 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ccb8af93-560e-4444-95e2-def64c607d73 req-30d09453-7390-491a-956b-46d5dd35b727 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ccb8af93-560e-4444-95e2-def64c607d73 req-30d09453-7390-491a-956b-46d5dd35b727 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:52 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-ccb8af93-560e-4444-95e2-def64c607d73 req-30d09453-7390-491a-956b-46d5dd35b727 service nova] Creating event network-changed:43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 on user Apr 14 17:21:52 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-ccb8af93-560e-4444-95e2-def64c607d73 req-30d09453-7390-491a-956b-46d5dd35b727 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056952 Apr 14 17:21:52 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 256/776] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:21:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:21:52 user devstack@n-api.service[61934]: DEBUG nova.objects.instance [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lazy-loading 'services' on Instance uuid 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 {{(pid=61934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:21:52 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-b3eef911-2e2c-4550-b5d8-e73dc4c3108b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/os-volume_attachments/ca8ff0ff-f007-4ffc-ab66-a99af6974027" status: 202 len: 0 microversion: 2.1 time: 0.177047 Apr 14 17:21:52 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 259/777] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:21:52 2023] DELETE /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/os-volume_attachments/ca8ff0ff-f007-4ffc-ab66-a99af6974027 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:21:52 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-b08c19a4-d8c4-4d71-8962-71ae1a561260 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:21:52 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-b08c19a4-d8c4-4d71-8962-71ae1a561260 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:21:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b08c19a4-d8c4-4d71-8962-71ae1a561260 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b08c19a4-d8c4-4d71-8962-71ae1a561260 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b08c19a4-d8c4-4d71-8962-71ae1a561260 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b08c19a4-d8c4-4d71-8962-71ae1a561260 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:21:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b08c19a4-d8c4-4d71-8962-71ae1a561260 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:21:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b08c19a4-d8c4-4d71-8962-71ae1a561260 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:21:52 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-b08c19a4-d8c4-4d71-8962-71ae1a561260 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047826 Apr 14 17:21:52 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 263/778] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:21:52 2023] GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:22:02 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-7b7c86d1-39ad-40e2-8423-334a0ab482f6 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:02 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-7b7c86d1-39ad-40e2-8423-334a0ab482f6 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7b7c86d1-39ad-40e2-8423-334a0ab482f6 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7b7c86d1-39ad-40e2-8423-334a0ab482f6 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7b7c86d1-39ad-40e2-8423-334a0ab482f6 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7b7c86d1-39ad-40e2-8423-334a0ab482f6 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7b7c86d1-39ad-40e2-8423-334a0ab482f6 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7b7c86d1-39ad-40e2-8423-334a0ab482f6 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:02 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-7b7c86d1-39ad-40e2-8423-334a0ab482f6 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:22:02 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-7b7c86d1-39ad-40e2-8423-334a0ab482f6 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:22:02 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-7b7c86d1-39ad-40e2-8423-334a0ab482f6 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:22:02 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-7b7c86d1-39ad-40e2-8423-334a0ab482f6 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" status: 200 len: 1754 microversion: 2.87 time: 0.300748 Apr 14 17:22:02 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 257/779] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:22:02 2023] GET /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 => generated 1754 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:22:05 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:22:05 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:22:05 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-84b0ad94-5420-42e3-8107-3f9eff0a36de tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:05 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-84b0ad94-5420-42e3-8107-3f9eff0a36de tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-84b0ad94-5420-42e3-8107-3f9eff0a36de tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-84b0ad94-5420-42e3-8107-3f9eff0a36de tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-84b0ad94-5420-42e3-8107-3f9eff0a36de tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-84b0ad94-5420-42e3-8107-3f9eff0a36de tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-84b0ad94-5420-42e3-8107-3f9eff0a36de tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-84b0ad94-5420-42e3-8107-3f9eff0a36de tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:06 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-84b0ad94-5420-42e3-8107-3f9eff0a36de tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ea39d187c842788168909de203455e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ab08f97dd54832a7cc975934b1b69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:22:06 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-84b0ad94-5420-42e3-8107-3f9eff0a36de tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682" status: 200 len: 1538 microversion: 2.1 time: 0.286936 Apr 14 17:22:06 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 260/780] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:22:05 2023] GET /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682 => generated 1538 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:22:08 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-426ebaaf-f330-47b9-ac0c-cb8d99110d6f req-557818a1-f260-44be-91de-4ffac0403353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a48598-5e5d-450b-a6c5-d7637a6d8682", "tag": "4e3c902c-c5f1-4842-8338-fc701ab2e11a"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:22:08 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=12 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:22:08 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=20 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:22:08 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-426ebaaf-f330-47b9-ac0c-cb8d99110d6f req-557818a1-f260-44be-91de-4ffac0403353 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:08 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-426ebaaf-f330-47b9-ac0c-cb8d99110d6f req-557818a1-f260-44be-91de-4ffac0403353 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:08 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-426ebaaf-f330-47b9-ac0c-cb8d99110d6f req-557818a1-f260-44be-91de-4ffac0403353 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:08 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-426ebaaf-f330-47b9-ac0c-cb8d99110d6f req-557818a1-f260-44be-91de-4ffac0403353 service nova] Creating event network-changed:4e3c902c-c5f1-4842-8338-fc701ab2e11a for instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 on user Apr 14 17:22:08 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-426ebaaf-f330-47b9-ac0c-cb8d99110d6f req-557818a1-f260-44be-91de-4ffac0403353 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040996 Apr 14 17:22:08 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 264/781] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:22:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:22:08 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a4503ad-f051-411d-a9c8-b5900017cda6"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:22:08 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:08 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:22:08 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:08 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:08 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:08 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:08 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:08 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:08 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:22:08 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-23eef92a-d8c4-4892-9528-daf4618a6f17 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "POST /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337278 Apr 14 17:22:08 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 258/782] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:22:08 2023] POST /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:22:09 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-2f2260a3-3cd8-4569-ad81-19d95d5300e8 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:09 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-2f2260a3-3cd8-4569-ad81-19d95d5300e8 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2f2260a3-3cd8-4569-ad81-19d95d5300e8 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2f2260a3-3cd8-4569-ad81-19d95d5300e8 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2f2260a3-3cd8-4569-ad81-19d95d5300e8 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2f2260a3-3cd8-4569-ad81-19d95d5300e8 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2f2260a3-3cd8-4569-ad81-19d95d5300e8 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2f2260a3-3cd8-4569-ad81-19d95d5300e8 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:09 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-2f2260a3-3cd8-4569-ad81-19d95d5300e8 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:22:09 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-2f2260a3-3cd8-4569-ad81-19d95d5300e8 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c" status: 200 len: 1702 microversion: 2.1 time: 0.372409 Apr 14 17:22:09 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 261/783] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:22:09 2023] GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c => generated 1702 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:22:17 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:17 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:17 user devstack@n-api.service[61935]: DEBUG nova.objects.instance [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lazy-loading 'services' on Instance uuid 15a48598-5e5d-450b-a6c5-d7637a6d8682 {{(pid=61935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:22:17 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-8fdb8fce-c59d-49ea-a7ef-8e61393b92ae tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682/os-volume_attachments/7a4503ad-f051-411d-a9c8-b5900017cda6" status: 202 len: 0 microversion: 2.1 time: 0.173538 Apr 14 17:22:17 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 265/784] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:22:17 2023] DELETE /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682/os-volume_attachments/7a4503ad-f051-411d-a9c8-b5900017cda6 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:22:17 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-03a88ccc-c441-4750-af11-51f4687edd20 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:17 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-03a88ccc-c441-4750-af11-51f4687edd20 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-03a88ccc-c441-4750-af11-51f4687edd20 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-03a88ccc-c441-4750-af11-51f4687edd20 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-03a88ccc-c441-4750-af11-51f4687edd20 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-03a88ccc-c441-4750-af11-51f4687edd20 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-03a88ccc-c441-4750-af11-51f4687edd20 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-03a88ccc-c441-4750-af11-51f4687edd20 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:17 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-03a88ccc-c441-4750-af11-51f4687edd20 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048699 Apr 14 17:22:17 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 259/785] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:22:17 2023] GET /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:22:28 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-37667d2f-8b87-413f-be40-3a71aa2eb139 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:28 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-37667d2f-8b87-413f-be40-3a71aa2eb139 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:28 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:22:28 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=12 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:22:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-37667d2f-8b87-413f-be40-3a71aa2eb139 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-37667d2f-8b87-413f-be40-3a71aa2eb139 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-37667d2f-8b87-413f-be40-3a71aa2eb139 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-37667d2f-8b87-413f-be40-3a71aa2eb139 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-37667d2f-8b87-413f-be40-3a71aa2eb139 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-37667d2f-8b87-413f-be40-3a71aa2eb139 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:28 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-37667d2f-8b87-413f-be40-3a71aa2eb139 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] HTTP exception thrown: Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd could not be found. Apr 14 17:22:28 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-37667d2f-8b87-413f-be40-3a71aa2eb139 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Request method failure captured: Apr 14 17:22:28 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd HTTP/1.1 Apr 14 17:22:28 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:22:28 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:22:28 user devstack@n-api.service[61934]: Connection: close Apr 14 17:22:28 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:22:28 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:22:28 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:22:28 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:22:28 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:22:28 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYiR2qMgL7kTyu29oUewuhK2BMhD1yDhsjSW-F_GgWrGh5KUHTr954Dh796RqAVsKDeAYXIov_JQ0Gk8H844eWVu4KllMwIeC7MZbuFVkr5pm_7CHOrJrhWIz7_b-q3A-nHbwyUF04SaDEpVQEXx1rxtb-bqSR-98BNEE8BrIOPN2B4 Apr 14 17:22:28 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:22:28 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:22:28 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:22:28 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:22:28 user devstack@n-api.service[61934]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 17:22:28 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:22:28 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:22:28 user devstack@n-api.service[61934]: X-Project-Id: 1ae1b41823a64cd0b1c1a1669ad202ec Apr 14 17:22:28 user devstack@n-api.service[61934]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-339689049 Apr 14 17:22:28 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:22:28 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:22:28 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ae1b41823a64cd0b1c1a1669ad202ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ae1b41823a64cd0b1c1a1669ad202ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1ae1b41823a64cd0b1c1a1669ad202ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:22:28 user devstack@n-api.service[61934]: X-Tenant: tempest-AttachVolumeShelveTestJSON-339689049 Apr 14 17:22:28 user devstack@n-api.service[61934]: X-Tenant-Id: 1ae1b41823a64cd0b1c1a1669ad202ec Apr 14 17:22:28 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-339689049 Apr 14 17:22:28 user devstack@n-api.service[61934]: X-User: tempest-AttachVolumeShelveTestJSON-339689049-project-member Apr 14 17:22:28 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:22:28 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:22:28 user devstack@n-api.service[61934]: X-User-Id: 6aa926d6cfc94b08a564404f95da5483 Apr 14 17:22:28 user devstack@n-api.service[61934]: X-User-Name: tempest-AttachVolumeShelveTestJSON-339689049-project-member Apr 14 17:22:28 user devstack@n-api.service[61934]: method: > Apr 14 17:22:28 user devstack@n-api.service[61934]: exception: Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd could not be found. Apr 14 17:22:28 user devstack@n-api.service[61934]: action_args: {'id': '49931fa3-281e-43d0-a3e9-fde8f502b2cd'} Apr 14 17:22:28 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd could not be found. Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd could not be found. Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd could not be found. Apr 14 17:22:28 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:28 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-37667d2f-8b87-413f-be40-3a71aa2eb139 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Returning 404 to user: Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:22:28 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-37667d2f-8b87-413f-be40-3a71aa2eb139 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd" status: 404 len: 111 microversion: 2.20 time: 0.042125 Apr 14 17:22:28 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 262/786] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:22:28 2023] GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:22:28 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:22:28 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:22:28 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-ed010d76-32a0-499b-a74f-48e02aa8a227 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '.version_select at 0x7fe19cdc2950>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:28 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-ed010d76-32a0-499b-a74f-48e02aa8a227 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2079826628" status: 204 len: 0 microversion: 2.20 time: 0.038402 Apr 14 17:22:28 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 266/787] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 17:22:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2079826628 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 17:22:32 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-5039c038-77f8-41e7-abd1-1b1e15593a0c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:32 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-5039c038-77f8-41e7-abd1-1b1e15593a0c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:32 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=3 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:22:32 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:22:32 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5039c038-77f8-41e7-abd1-1b1e15593a0c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:32 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5039c038-77f8-41e7-abd1-1b1e15593a0c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:32 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5039c038-77f8-41e7-abd1-1b1e15593a0c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:32 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5039c038-77f8-41e7-abd1-1b1e15593a0c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:32 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5039c038-77f8-41e7-abd1-1b1e15593a0c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:32 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5039c038-77f8-41e7-abd1-1b1e15593a0c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:32 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-5039c038-77f8-41e7-abd1-1b1e15593a0c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] HTTP exception thrown: Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd could not be found. Apr 14 17:22:32 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-5039c038-77f8-41e7-abd1-1b1e15593a0c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Request method failure captured: Apr 14 17:22:32 user devstack@n-api.service[61933]: request: DELETE /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd HTTP/1.1 Apr 14 17:22:32 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:22:32 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:22:32 user devstack@n-api.service[61933]: Connection: close Apr 14 17:22:32 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:22:32 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:22:32 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:22:32 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:22:32 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:22:32 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYiR2qMgL7kTyu29oUewuhK2BMhD1yDhsjSW-F_GgWrGh5KUHTr954Dh796RqAVsKDeAYXIov_JQ0Gk8H844eWVu4KllMwIeC7MZbuFVkr5pm_7CHOrJrhWIz7_b-q3A-nHbwyUF04SaDEpVQEXx1rxtb-bqSR-98BNEE8BrIOPN2B4 Apr 14 17:22:32 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:22:32 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:22:32 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:22:32 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:22:32 user devstack@n-api.service[61933]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 17:22:32 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:22:32 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:22:32 user devstack@n-api.service[61933]: X-Project-Id: 1ae1b41823a64cd0b1c1a1669ad202ec Apr 14 17:22:32 user devstack@n-api.service[61933]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-339689049 Apr 14 17:22:32 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:22:32 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:22:32 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ae1b41823a64cd0b1c1a1669ad202ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ae1b41823a64cd0b1c1a1669ad202ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1ae1b41823a64cd0b1c1a1669ad202ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:22:32 user devstack@n-api.service[61933]: X-Tenant: tempest-AttachVolumeShelveTestJSON-339689049 Apr 14 17:22:32 user devstack@n-api.service[61933]: X-Tenant-Id: 1ae1b41823a64cd0b1c1a1669ad202ec Apr 14 17:22:32 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-339689049 Apr 14 17:22:32 user devstack@n-api.service[61933]: X-User: tempest-AttachVolumeShelveTestJSON-339689049-project-member Apr 14 17:22:32 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:22:32 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:22:32 user devstack@n-api.service[61933]: X-User-Id: 6aa926d6cfc94b08a564404f95da5483 Apr 14 17:22:32 user devstack@n-api.service[61933]: X-User-Name: tempest-AttachVolumeShelveTestJSON-339689049-project-member Apr 14 17:22:32 user devstack@n-api.service[61933]: method: > Apr 14 17:22:32 user devstack@n-api.service[61933]: exception: Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd could not be found. Apr 14 17:22:32 user devstack@n-api.service[61933]: action_args: {'id': '49931fa3-281e-43d0-a3e9-fde8f502b2cd'} Apr 14 17:22:32 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd could not be found. Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd could not be found. Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd could not be found. Apr 14 17:22:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:22:32 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-5039c038-77f8-41e7-abd1-1b1e15593a0c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Returning 404 to user: Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:22:32 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-5039c038-77f8-41e7-abd1-1b1e15593a0c tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd" status: 404 len: 111 microversion: 2.20 time: 0.039761 Apr 14 17:22:32 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 260/788] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 17:22:32 2023] DELETE /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:22:32 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-8579a552-8ab3-435d-a5f1-37288ba4b90b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:32 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-8579a552-8ab3-435d-a5f1-37288ba4b90b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: 49931fa3-281e-43d0-a3e9-fde8f502b2cd] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8579a552-8ab3-435d-a5f1-37288ba4b90b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8579a552-8ab3-435d-a5f1-37288ba4b90b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8579a552-8ab3-435d-a5f1-37288ba4b90b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8579a552-8ab3-435d-a5f1-37288ba4b90b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8579a552-8ab3-435d-a5f1-37288ba4b90b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-8579a552-8ab3-435d-a5f1-37288ba4b90b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:33 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-8579a552-8ab3-435d-a5f1-37288ba4b90b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] HTTP exception thrown: Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd could not be found. Apr 14 17:22:33 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-8579a552-8ab3-435d-a5f1-37288ba4b90b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Request method failure captured: Apr 14 17:22:33 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd HTTP/1.1 Apr 14 17:22:33 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:22:33 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:22:33 user devstack@n-api.service[61934]: Connection: close Apr 14 17:22:33 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:22:33 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:22:33 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:22:33 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:22:33 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:22:33 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYiR2qMgL7kTyu29oUewuhK2BMhD1yDhsjSW-F_GgWrGh5KUHTr954Dh796RqAVsKDeAYXIov_JQ0Gk8H844eWVu4KllMwIeC7MZbuFVkr5pm_7CHOrJrhWIz7_b-q3A-nHbwyUF04SaDEpVQEXx1rxtb-bqSR-98BNEE8BrIOPN2B4 Apr 14 17:22:33 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:22:33 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:22:33 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:22:33 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:22:33 user devstack@n-api.service[61934]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 17:22:33 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:22:33 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:22:33 user devstack@n-api.service[61934]: X-Project-Id: 1ae1b41823a64cd0b1c1a1669ad202ec Apr 14 17:22:33 user devstack@n-api.service[61934]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-339689049 Apr 14 17:22:33 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:22:33 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:22:33 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ae1b41823a64cd0b1c1a1669ad202ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ae1b41823a64cd0b1c1a1669ad202ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1ae1b41823a64cd0b1c1a1669ad202ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:22:33 user devstack@n-api.service[61934]: X-Tenant: tempest-AttachVolumeShelveTestJSON-339689049 Apr 14 17:22:33 user devstack@n-api.service[61934]: X-Tenant-Id: 1ae1b41823a64cd0b1c1a1669ad202ec Apr 14 17:22:33 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-339689049 Apr 14 17:22:33 user devstack@n-api.service[61934]: X-User: tempest-AttachVolumeShelveTestJSON-339689049-project-member Apr 14 17:22:33 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:22:33 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:22:33 user devstack@n-api.service[61934]: X-User-Id: 6aa926d6cfc94b08a564404f95da5483 Apr 14 17:22:33 user devstack@n-api.service[61934]: X-User-Name: tempest-AttachVolumeShelveTestJSON-339689049-project-member Apr 14 17:22:33 user devstack@n-api.service[61934]: method: > Apr 14 17:22:33 user devstack@n-api.service[61934]: exception: Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd could not be found. Apr 14 17:22:33 user devstack@n-api.service[61934]: action_args: {'id': '49931fa3-281e-43d0-a3e9-fde8f502b2cd'} Apr 14 17:22:33 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd could not be found. Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd could not be found. Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd could not be found. Apr 14 17:22:33 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:33 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-8579a552-8ab3-435d-a5f1-37288ba4b90b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Returning 404 to user: Instance 49931fa3-281e-43d0-a3e9-fde8f502b2cd could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:22:33 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-8579a552-8ab3-435d-a5f1-37288ba4b90b tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd" status: 404 len: 111 microversion: 2.20 time: 0.035478 Apr 14 17:22:33 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 263/789] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:22:32 2023] GET /compute/v2.1/servers/49931fa3-281e-43d0-a3e9-fde8f502b2cd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:22:34 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-b0ad6a41-c5e4-44b8-8b32-02be670047de tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:34 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-b0ad6a41-c5e4-44b8-8b32-02be670047de tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b0ad6a41-c5e4-44b8-8b32-02be670047de tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b0ad6a41-c5e4-44b8-8b32-02be670047de tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b0ad6a41-c5e4-44b8-8b32-02be670047de tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b0ad6a41-c5e4-44b8-8b32-02be670047de tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b0ad6a41-c5e4-44b8-8b32-02be670047de tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:34 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b0ad6a41-c5e4-44b8-8b32-02be670047de tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:34 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-b0ad6a41-c5e4-44b8-8b32-02be670047de tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecae496b720c4e09b90986969d9ae9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3e0c3b9c7b4ca79b75def0f04f5549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:22:34 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-b0ad6a41-c5e4-44b8-8b32-02be670047de tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b" status: 200 len: 1567 microversion: 2.1 time: 0.276847 Apr 14 17:22:34 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 267/790] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:22:34 2023] GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:22:37 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-18bf6902-af33-4de8-be36-b62fdb087533 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:37 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-18bf6902-af33-4de8-be36-b62fdb087533 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-18bf6902-af33-4de8-be36-b62fdb087533 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-18bf6902-af33-4de8-be36-b62fdb087533 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-18bf6902-af33-4de8-be36-b62fdb087533 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-18bf6902-af33-4de8-be36-b62fdb087533 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-18bf6902-af33-4de8-be36-b62fdb087533 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-18bf6902-af33-4de8-be36-b62fdb087533 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:37 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-18bf6902-af33-4de8-be36-b62fdb087533 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] HTTP exception thrown: Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c could not be found. Apr 14 17:22:37 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-18bf6902-af33-4de8-be36-b62fdb087533 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Request method failure captured: Apr 14 17:22:37 user devstack@n-api.service[61933]: request: DELETE /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c HTTP/1.1 Apr 14 17:22:37 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:22:37 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:22:37 user devstack@n-api.service[61933]: Connection: close Apr 14 17:22:37 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:22:37 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:22:37 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:22:37 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:22:37 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:22:37 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYiR2qMgL7kTyu29oUewuhK2BMhD1yDhsjSW-F_GgWrGh5KUHTr954Dh796RqAVsKDeAYXIov_JQ0Gk8H844eWVu4KllMwIeC7MZbuFVkr5pm_7CHOrJrhWIz7_b-q3A-nHbwyUF04SaDEpVQEXx1rxtb-bqSR-98BNEE8BrIOPN2B4 Apr 14 17:22:37 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:22:37 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:22:37 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:22:37 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:22:37 user devstack@n-api.service[61933]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 17:22:37 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:22:37 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:22:37 user devstack@n-api.service[61933]: X-Project-Id: 1ae1b41823a64cd0b1c1a1669ad202ec Apr 14 17:22:37 user devstack@n-api.service[61933]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-339689049 Apr 14 17:22:37 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:22:37 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:22:37 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ae1b41823a64cd0b1c1a1669ad202ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ae1b41823a64cd0b1c1a1669ad202ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1ae1b41823a64cd0b1c1a1669ad202ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:22:37 user devstack@n-api.service[61933]: X-Tenant: tempest-AttachVolumeShelveTestJSON-339689049 Apr 14 17:22:37 user devstack@n-api.service[61933]: X-Tenant-Id: 1ae1b41823a64cd0b1c1a1669ad202ec Apr 14 17:22:37 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-339689049 Apr 14 17:22:37 user devstack@n-api.service[61933]: X-User: tempest-AttachVolumeShelveTestJSON-339689049-project-member Apr 14 17:22:37 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:22:37 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:22:37 user devstack@n-api.service[61933]: X-User-Id: 6aa926d6cfc94b08a564404f95da5483 Apr 14 17:22:37 user devstack@n-api.service[61933]: X-User-Name: tempest-AttachVolumeShelveTestJSON-339689049-project-member Apr 14 17:22:37 user devstack@n-api.service[61933]: method: > Apr 14 17:22:37 user devstack@n-api.service[61933]: exception: Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c could not be found. Apr 14 17:22:37 user devstack@n-api.service[61933]: action_args: {'id': 'a0fe02ed-b8cd-43ac-9210-d36e8c90de5c'} Apr 14 17:22:37 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c could not be found. Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c could not be found. Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c could not be found. Apr 14 17:22:37 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:22:37 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-18bf6902-af33-4de8-be36-b62fdb087533 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Returning 404 to user: Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:22:37 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-18bf6902-af33-4de8-be36-b62fdb087533 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" status: 404 len: 111 microversion: 2.20 time: 0.042913 Apr 14 17:22:37 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 261/791] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 17:22:37 2023] DELETE /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:22:37 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-b28bf05a-cbf9-4b71-a7ac-49c7713aa043 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:37 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-b28bf05a-cbf9-4b71-a7ac-49c7713aa043 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] [instance: a0fe02ed-b8cd-43ac-9210-d36e8c90de5c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:37 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b28bf05a-cbf9-4b71-a7ac-49c7713aa043 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:37 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b28bf05a-cbf9-4b71-a7ac-49c7713aa043 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:37 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b28bf05a-cbf9-4b71-a7ac-49c7713aa043 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:37 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b28bf05a-cbf9-4b71-a7ac-49c7713aa043 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:37 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b28bf05a-cbf9-4b71-a7ac-49c7713aa043 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:37 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b28bf05a-cbf9-4b71-a7ac-49c7713aa043 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:37 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-b28bf05a-cbf9-4b71-a7ac-49c7713aa043 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] HTTP exception thrown: Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c could not be found. Apr 14 17:22:37 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-b28bf05a-cbf9-4b71-a7ac-49c7713aa043 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Request method failure captured: Apr 14 17:22:37 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c HTTP/1.1 Apr 14 17:22:37 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:22:37 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:22:37 user devstack@n-api.service[61934]: Connection: close Apr 14 17:22:37 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:22:37 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:22:37 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:22:37 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:22:37 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:22:37 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYiR2qMgL7kTyu29oUewuhK2BMhD1yDhsjSW-F_GgWrGh5KUHTr954Dh796RqAVsKDeAYXIov_JQ0Gk8H844eWVu4KllMwIeC7MZbuFVkr5pm_7CHOrJrhWIz7_b-q3A-nHbwyUF04SaDEpVQEXx1rxtb-bqSR-98BNEE8BrIOPN2B4 Apr 14 17:22:37 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:22:37 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:22:37 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:22:37 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:22:37 user devstack@n-api.service[61934]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 17:22:37 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:22:37 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:22:37 user devstack@n-api.service[61934]: X-Project-Id: 1ae1b41823a64cd0b1c1a1669ad202ec Apr 14 17:22:37 user devstack@n-api.service[61934]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-339689049 Apr 14 17:22:37 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:22:37 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:22:37 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ae1b41823a64cd0b1c1a1669ad202ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ae1b41823a64cd0b1c1a1669ad202ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1ae1b41823a64cd0b1c1a1669ad202ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:22:37 user devstack@n-api.service[61934]: X-Tenant: tempest-AttachVolumeShelveTestJSON-339689049 Apr 14 17:22:37 user devstack@n-api.service[61934]: X-Tenant-Id: 1ae1b41823a64cd0b1c1a1669ad202ec Apr 14 17:22:37 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-339689049 Apr 14 17:22:37 user devstack@n-api.service[61934]: X-User: tempest-AttachVolumeShelveTestJSON-339689049-project-member Apr 14 17:22:37 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:22:37 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:22:37 user devstack@n-api.service[61934]: X-User-Id: 6aa926d6cfc94b08a564404f95da5483 Apr 14 17:22:37 user devstack@n-api.service[61934]: X-User-Name: tempest-AttachVolumeShelveTestJSON-339689049-project-member Apr 14 17:22:37 user devstack@n-api.service[61934]: method: > Apr 14 17:22:37 user devstack@n-api.service[61934]: exception: Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c could not be found. Apr 14 17:22:37 user devstack@n-api.service[61934]: action_args: {'id': 'a0fe02ed-b8cd-43ac-9210-d36e8c90de5c'} Apr 14 17:22:37 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c could not be found. Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c could not be found. Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c could not be found. Apr 14 17:22:37 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:37 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-b28bf05a-cbf9-4b71-a7ac-49c7713aa043 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] Returning 404 to user: Instance a0fe02ed-b8cd-43ac-9210-d36e8c90de5c could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:22:37 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-b28bf05a-cbf9-4b71-a7ac-49c7713aa043 tempest-AttachVolumeShelveTestJSON-339689049 tempest-AttachVolumeShelveTestJSON-339689049-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c" status: 404 len: 111 microversion: 2.20 time: 0.039084 Apr 14 17:22:37 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 264/792] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:22:37 2023] GET /compute/v2.1/servers/a0fe02ed-b8cd-43ac-9210-d36e8c90de5c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:22:38 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-79b3e6c4-6270-4b68-b5a6-b08719e7a31b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:38 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-79b3e6c4-6270-4b68-b5a6-b08719e7a31b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-79b3e6c4-6270-4b68-b5a6-b08719e7a31b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-79b3e6c4-6270-4b68-b5a6-b08719e7a31b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-79b3e6c4-6270-4b68-b5a6-b08719e7a31b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-79b3e6c4-6270-4b68-b5a6-b08719e7a31b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-79b3e6c4-6270-4b68-b5a6-b08719e7a31b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-79b3e6c4-6270-4b68-b5a6-b08719e7a31b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:39 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-79b3e6c4-6270-4b68-b5a6-b08719e7a31b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] HTTP exception thrown: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-79b3e6c4-6270-4b68-b5a6-b08719e7a31b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Request method failure captured: Apr 14 17:22:39 user devstack@n-api.service[61935]: request: GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 HTTP/1.1 Apr 14 17:22:39 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:22:39 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:22:39 user devstack@n-api.service[61935]: Connection: close Apr 14 17:22:39 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:22:39 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:22:39 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:22:39 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:22:39 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:22:39 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYh8HXXsf4bGlYrF_fOxQUmdFUk7ZjLLaQJs1zhxzjKy7c02nJ0ir8GYyoaprYCg0-4meGkGc2Z-BXH5-OvDeF0zr4fMdtzNd3C0ulgEACJz9sX5KqJt6iV8Bmpo3VUcdYwHyEQnBhpBhEqdSs6U3O3UogQINVr4C9pTqKOyF0aPHhM Apr 14 17:22:39 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:22:39 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:22:39 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:22:39 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:22:39 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:22:39 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:22:39 user devstack@n-api.service[61935]: X-Project-Id: 978cd1b4b6434b298731b01dac02591c Apr 14 17:22:39 user devstack@n-api.service[61935]: X-Project-Name: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:22:39 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:22:39 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:22:39 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:22:39 user devstack@n-api.service[61935]: X-Tenant: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:22:39 user devstack@n-api.service[61935]: X-Tenant-Id: 978cd1b4b6434b298731b01dac02591c Apr 14 17:22:39 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:22:39 user devstack@n-api.service[61935]: X-User: tempest-ServerActionsTestJSON-2079488933-project-member Apr 14 17:22:39 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:22:39 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:22:39 user devstack@n-api.service[61935]: X-User-Id: a22398c18fcc48aca2f0f9691f1c1143 Apr 14 17:22:39 user devstack@n-api.service[61935]: X-User-Name: tempest-ServerActionsTestJSON-2079488933-project-member Apr 14 17:22:39 user devstack@n-api.service[61935]: method: > Apr 14 17:22:39 user devstack@n-api.service[61935]: exception: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:22:39 user devstack@n-api.service[61935]: action_args: {'id': '84c02556-abf7-4832-a1b2-a2c28a7f8e52'} Apr 14 17:22:39 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:22:39 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-79b3e6c4-6270-4b68-b5a6-b08719e7a31b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Returning 404 to user: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:22:39 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-79b3e6c4-6270-4b68-b5a6-b08719e7a31b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 404 len: 111 microversion: 2.1 time: 0.034158 Apr 14 17:22:39 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 268/793] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:22:38 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:22:39 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-736e43a8-9ddb-4d98-a704-2e5aed17641a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:39 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-736e43a8-9ddb-4d98-a704-2e5aed17641a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-736e43a8-9ddb-4d98-a704-2e5aed17641a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-736e43a8-9ddb-4d98-a704-2e5aed17641a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-736e43a8-9ddb-4d98-a704-2e5aed17641a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-736e43a8-9ddb-4d98-a704-2e5aed17641a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-736e43a8-9ddb-4d98-a704-2e5aed17641a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-736e43a8-9ddb-4d98-a704-2e5aed17641a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-736e43a8-9ddb-4d98-a704-2e5aed17641a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] HTTP exception thrown: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:22:39 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-736e43a8-9ddb-4d98-a704-2e5aed17641a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Request method failure captured: Apr 14 17:22:39 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/os-volume_attachments HTTP/1.1 Apr 14 17:22:39 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:22:39 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:22:39 user devstack@n-api.service[61933]: Connection: close Apr 14 17:22:39 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:22:39 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:22:39 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:22:39 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:22:39 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:22:39 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYh8HXXsf4bGlYrF_fOxQUmdFUk7ZjLLaQJs1zhxzjKy7c02nJ0ir8GYyoaprYCg0-4meGkGc2Z-BXH5-OvDeF0zr4fMdtzNd3C0ulgEACJz9sX5KqJt6iV8Bmpo3VUcdYwHyEQnBhpBhEqdSs6U3O3UogQINVr4C9pTqKOyF0aPHhM Apr 14 17:22:39 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:22:39 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:22:39 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:22:39 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:22:39 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:22:39 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:22:39 user devstack@n-api.service[61933]: X-Project-Id: 978cd1b4b6434b298731b01dac02591c Apr 14 17:22:39 user devstack@n-api.service[61933]: X-Project-Name: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:22:39 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:22:39 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:22:39 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:22:39 user devstack@n-api.service[61933]: X-Tenant: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:22:39 user devstack@n-api.service[61933]: X-Tenant-Id: 978cd1b4b6434b298731b01dac02591c Apr 14 17:22:39 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:22:39 user devstack@n-api.service[61933]: X-User: tempest-ServerActionsTestJSON-2079488933-project-member Apr 14 17:22:39 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:22:39 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:22:39 user devstack@n-api.service[61933]: X-User-Id: a22398c18fcc48aca2f0f9691f1c1143 Apr 14 17:22:39 user devstack@n-api.service[61933]: X-User-Name: tempest-ServerActionsTestJSON-2079488933-project-member Apr 14 17:22:39 user devstack@n-api.service[61933]: method: > Apr 14 17:22:39 user devstack@n-api.service[61933]: exception: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:22:39 user devstack@n-api.service[61933]: action_args: {'server_id': '84c02556-abf7-4832-a1b2-a2c28a7f8e52'} Apr 14 17:22:39 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:22:39 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:22:39 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-736e43a8-9ddb-4d98-a704-2e5aed17641a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Returning 404 to user: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:22:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-736e43a8-9ddb-4d98-a704-2e5aed17641a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030291 Apr 14 17:22:39 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 262/794] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:22:39 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:22:39 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-1be803bf-52e5-4da5-89a7-b9d76a356ba5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:39 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-1be803bf-52e5-4da5-89a7-b9d76a356ba5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:39 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1be803bf-52e5-4da5-89a7-b9d76a356ba5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:39 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1be803bf-52e5-4da5-89a7-b9d76a356ba5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:39 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1be803bf-52e5-4da5-89a7-b9d76a356ba5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:39 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1be803bf-52e5-4da5-89a7-b9d76a356ba5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:39 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1be803bf-52e5-4da5-89a7-b9d76a356ba5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:39 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-1be803bf-52e5-4da5-89a7-b9d76a356ba5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:39 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-1be803bf-52e5-4da5-89a7-b9d76a356ba5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] HTTP exception thrown: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:22:39 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-1be803bf-52e5-4da5-89a7-b9d76a356ba5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Request method failure captured: Apr 14 17:22:39 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 HTTP/1.1 Apr 14 17:22:39 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:22:39 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:22:39 user devstack@n-api.service[61934]: Connection: close Apr 14 17:22:39 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:22:39 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:22:39 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:22:39 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:22:39 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:22:39 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYh8HXXsf4bGlYrF_fOxQUmdFUk7ZjLLaQJs1zhxzjKy7c02nJ0ir8GYyoaprYCg0-4meGkGc2Z-BXH5-OvDeF0zr4fMdtzNd3C0ulgEACJz9sX5KqJt6iV8Bmpo3VUcdYwHyEQnBhpBhEqdSs6U3O3UogQINVr4C9pTqKOyF0aPHhM Apr 14 17:22:39 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:22:39 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:22:39 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:22:39 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:22:39 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:22:39 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:22:39 user devstack@n-api.service[61934]: X-Project-Id: 978cd1b4b6434b298731b01dac02591c Apr 14 17:22:39 user devstack@n-api.service[61934]: X-Project-Name: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:22:39 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:22:39 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:22:39 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:22:39 user devstack@n-api.service[61934]: X-Tenant: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:22:39 user devstack@n-api.service[61934]: X-Tenant-Id: 978cd1b4b6434b298731b01dac02591c Apr 14 17:22:39 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:22:39 user devstack@n-api.service[61934]: X-User: tempest-ServerActionsTestJSON-2079488933-project-member Apr 14 17:22:39 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:22:39 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:22:39 user devstack@n-api.service[61934]: X-User-Id: a22398c18fcc48aca2f0f9691f1c1143 Apr 14 17:22:39 user devstack@n-api.service[61934]: X-User-Name: tempest-ServerActionsTestJSON-2079488933-project-member Apr 14 17:22:39 user devstack@n-api.service[61934]: method: > Apr 14 17:22:39 user devstack@n-api.service[61934]: exception: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:22:39 user devstack@n-api.service[61934]: action_args: {'id': '84c02556-abf7-4832-a1b2-a2c28a7f8e52'} Apr 14 17:22:39 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:22:39 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:39 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-1be803bf-52e5-4da5-89a7-b9d76a356ba5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Returning 404 to user: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:22:39 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-1be803bf-52e5-4da5-89a7-b9d76a356ba5 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 404 len: 111 microversion: 2.1 time: 0.033725 Apr 14 17:22:39 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 265/795] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:22:39 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-840202433", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "networks": [{"uuid": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d"}], "security_groups": [{"name": "tempest-securitygroup--1580043032"}], "key_name": "tempest-keypair-310941958", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG nova.network.neutron [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] validate_networks() for [('187c0a7b-9043-4eac-8ad7-2c72b6f23d4d', None, None, None, None, None)] {{(pid=61935) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting quotas for project 978cd1b4b6434b298731b01dac02591c. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting quotas for user a22398c18fcc48aca2f0f9691f1c1143 and project 978cd1b4b6434b298731b01dac02591c. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Going to run 1 instances... {{(pid=61935) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:22:39 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:22:40 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-b6f42f70-24b5-46fb-8f88-fd1f9627af89 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.681308 Apr 14 17:22:40 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 269/796] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:22:39 2023] POST /compute/v2.1/servers => generated 404 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:22:40 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b121cda6-2797-4b0c-a961-8650f028b567 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:40 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-b121cda6-2797-4b0c-a961-8650f028b567 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:40 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-b121cda6-2797-4b0c-a961-8650f028b567 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:22:40 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-b121cda6-2797-4b0c-a961-8650f028b567 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" status: 200 len: 1231 microversion: 2.1 time: 0.148947 Apr 14 17:22:40 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 263/797] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:22:40 2023] GET /compute/v2.1/servers/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 => generated 1231 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:22:40 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-bf70c72d-ec08-4b1d-bf95-1a2009ac9e4f req-56d94b5a-a874-497e-ae0c-879b9382120e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ce59e7-b263-4e0b-9f19-638db9606c7b", "tag": "7549a60b-8755-4baa-bf6b-6571c0cbb88b"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:22:40 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-bf70c72d-ec08-4b1d-bf95-1a2009ac9e4f req-56d94b5a-a874-497e-ae0c-879b9382120e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:40 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-bf70c72d-ec08-4b1d-bf95-1a2009ac9e4f req-56d94b5a-a874-497e-ae0c-879b9382120e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:40 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-bf70c72d-ec08-4b1d-bf95-1a2009ac9e4f req-56d94b5a-a874-497e-ae0c-879b9382120e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:40 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-bf70c72d-ec08-4b1d-bf95-1a2009ac9e4f req-56d94b5a-a874-497e-ae0c-879b9382120e service nova] Creating event network-changed:7549a60b-8755-4baa-bf6b-6571c0cbb88b for instance 15ce59e7-b263-4e0b-9f19-638db9606c7b on user Apr 14 17:22:40 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-bf70c72d-ec08-4b1d-bf95-1a2009ac9e4f req-56d94b5a-a874-497e-ae0c-879b9382120e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056237 Apr 14 17:22:40 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 266/798] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:22:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:22:40 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0e1588e-3447-4cc6-8740-d7a3b6af2807"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:22:40 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:40 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-5eac3ae1-559b-4a05-9d27-cf4e72e2c6fd tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "POST /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308936 Apr 14 17:22:40 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 270/799] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:22:40 2023] POST /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:22:42 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-afa51250-c6bc-4cb2-b34d-eae1c9b8bb9b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:42 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-afa51250-c6bc-4cb2-b34d-eae1c9b8bb9b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-afa51250-c6bc-4cb2-b34d-eae1c9b8bb9b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-afa51250-c6bc-4cb2-b34d-eae1c9b8bb9b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-afa51250-c6bc-4cb2-b34d-eae1c9b8bb9b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-afa51250-c6bc-4cb2-b34d-eae1c9b8bb9b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-afa51250-c6bc-4cb2-b34d-eae1c9b8bb9b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-afa51250-c6bc-4cb2-b34d-eae1c9b8bb9b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:43 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-afa51250-c6bc-4cb2-b34d-eae1c9b8bb9b tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057769 Apr 14 17:22:43 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 264/800] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:22:42 2023] GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:22:43 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-f81a9ea7-067f-4b80-bde0-496b4c679cf1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:43 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-f81a9ea7-067f-4b80-bde0-496b4c679cf1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:43 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f81a9ea7-067f-4b80-bde0-496b4c679cf1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:43 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f81a9ea7-067f-4b80-bde0-496b4c679cf1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:43 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f81a9ea7-067f-4b80-bde0-496b4c679cf1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:43 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f81a9ea7-067f-4b80-bde0-496b4c679cf1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:43 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f81a9ea7-067f-4b80-bde0-496b4c679cf1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:43 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f81a9ea7-067f-4b80-bde0-496b4c679cf1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:43 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-f81a9ea7-067f-4b80-bde0-496b4c679cf1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] HTTP exception thrown: Instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 is not attached to volume ca8ff0ff-f007-4ffc-ab66-a99af6974027 Apr 14 17:22:43 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-f81a9ea7-067f-4b80-bde0-496b4c679cf1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Request method failure captured: Apr 14 17:22:43 user devstack@n-api.service[61934]: request: DELETE /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/os-volume_attachments/ca8ff0ff-f007-4ffc-ab66-a99af6974027 HTTP/1.1 Apr 14 17:22:43 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:22:43 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:22:43 user devstack@n-api.service[61934]: Connection: close Apr 14 17:22:43 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:22:43 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:22:43 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:22:43 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:22:43 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:22:43 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYlH8oeecSNmWpcptJ7XQIg_czFAdoxZlEn7n9bZMWzl2Cey_zb44KiBPB5hBZCJuPRxZS0tzBAMtnKhqqdQ2MYOjUj8RmHi4TQSQ-tS3z_yl5OsJr6EVti0XIm87vd_6aqqJws-eEBXEZwCnCAh-boDeWVkYEkG4ObXm2GgFk8-T-M Apr 14 17:22:43 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:22:43 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:22:43 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:22:43 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:22:43 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:22:43 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:22:43 user devstack@n-api.service[61934]: X-Project-Id: 0a92a4f922f442a88cfb86f8239e52ac Apr 14 17:22:43 user devstack@n-api.service[61934]: X-Project-Name: tempest-TestMinimumBasicScenario-1645387059 Apr 14 17:22:43 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:22:43 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:22:43 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a92a4f922f442a88cfb86f8239e52ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a92a4f922f442a88cfb86f8239e52ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0a92a4f922f442a88cfb86f8239e52ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:22:43 user devstack@n-api.service[61934]: X-Tenant: tempest-TestMinimumBasicScenario-1645387059 Apr 14 17:22:43 user devstack@n-api.service[61934]: X-Tenant-Id: 0a92a4f922f442a88cfb86f8239e52ac Apr 14 17:22:43 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1645387059 Apr 14 17:22:43 user devstack@n-api.service[61934]: X-User: tempest-TestMinimumBasicScenario-1645387059-project-member Apr 14 17:22:43 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:22:43 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:22:43 user devstack@n-api.service[61934]: X-User-Id: 4bd0842f11b0499298e2af46ad659962 Apr 14 17:22:43 user devstack@n-api.service[61934]: X-User-Name: tempest-TestMinimumBasicScenario-1645387059-project-member Apr 14 17:22:43 user devstack@n-api.service[61934]: method: > Apr 14 17:22:43 user devstack@n-api.service[61934]: exception: Instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 is not attached to volume ca8ff0ff-f007-4ffc-ab66-a99af6974027 Apr 14 17:22:43 user devstack@n-api.service[61934]: action_args: {'server_id': '6a5ebe0f-81d3-4dbc-b55f-4c42d2857715', 'id': 'ca8ff0ff-f007-4ffc-ab66-a99af6974027'} Apr 14 17:22:43 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ca8ff0ff-f007-4ffc-ab66-a99af6974027. Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 is not attached to volume ca8ff0ff-f007-4ffc-ab66-a99af6974027 Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 is not attached to volume ca8ff0ff-f007-4ffc-ab66-a99af6974027 Apr 14 17:22:43 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:22:43 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-f81a9ea7-067f-4b80-bde0-496b4c679cf1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Returning 404 to user: Instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 is not attached to volume ca8ff0ff-f007-4ffc-ab66-a99af6974027 {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:22:43 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-f81a9ea7-067f-4b80-bde0-496b4c679cf1 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/os-volume_attachments/ca8ff0ff-f007-4ffc-ab66-a99af6974027" status: 404 len: 154 microversion: 2.1 time: 0.117449 Apr 14 17:22:43 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 267/801] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:22:43 2023] DELETE /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715/os-volume_attachments/ca8ff0ff-f007-4ffc-ab66-a99af6974027 => generated 154 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 17:22:43 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-f98f669e-d883-41b2-bd21-a500f28beb20 req-93f9ea3c-c9bf-4871-bec6-dc78fbc1a6af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88", "tag": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:22:43 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-f98f669e-d883-41b2-bd21-a500f28beb20 req-93f9ea3c-c9bf-4871-bec6-dc78fbc1a6af service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:43 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-f98f669e-d883-41b2-bd21-a500f28beb20 req-93f9ea3c-c9bf-4871-bec6-dc78fbc1a6af service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:43 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-f98f669e-d883-41b2-bd21-a500f28beb20 req-93f9ea3c-c9bf-4871-bec6-dc78fbc1a6af service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:43 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-f98f669e-d883-41b2-bd21-a500f28beb20 req-93f9ea3c-c9bf-4871-bec6-dc78fbc1a6af service nova] Creating event network-changed:ff6f2e44-8051-46b5-9b63-46b5fcc6db6a for instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 on user Apr 14 17:22:43 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-f98f669e-d883-41b2-bd21-a500f28beb20 req-93f9ea3c-c9bf-4871-bec6-dc78fbc1a6af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046230 Apr 14 17:22:43 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 271/802] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:22:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:22:45 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-d5019f93-5f76-4957-a51e-20dfadf31bd4 req-3ec85354-d0dc-4837-9c6f-325fef30354f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88", "name": "network-vif-plugged", "status": "completed", "tag": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:22:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-d5019f93-5f76-4957-a51e-20dfadf31bd4 req-3ec85354-d0dc-4837-9c6f-325fef30354f service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-d5019f93-5f76-4957-a51e-20dfadf31bd4 req-3ec85354-d0dc-4837-9c6f-325fef30354f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-d5019f93-5f76-4957-a51e-20dfadf31bd4 req-3ec85354-d0dc-4837-9c6f-325fef30354f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:45 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-d5019f93-5f76-4957-a51e-20dfadf31bd4 req-3ec85354-d0dc-4837-9c6f-325fef30354f service nova] Creating event network-vif-plugged:ff6f2e44-8051-46b5-9b63-46b5fcc6db6a for instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 on user Apr 14 17:22:45 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-d5019f93-5f76-4957-a51e-20dfadf31bd4 req-3ec85354-d0dc-4837-9c6f-325fef30354f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041450 Apr 14 17:22:45 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 268/803] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:22:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:22:45 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-349861328", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "networks": [{"uuid": "437e4b37-0441-4e16-8f44-0e61729d4718"}]}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:22:45 user devstack@n-api.service[61933]: DEBUG nova.network.neutron [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] validate_networks() for [('437e4b37-0441-4e16-8f44-0e61729d4718', None, None, None, None, None)] {{(pid=61933) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:22:46 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Flavor limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:22:46 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Image limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:22:46 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Flavor pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:22:46 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Image pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:22:46 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:22:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:46 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Getting quotas for project 42aeec65dc86431ba3a607e0c425f130. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:22:46 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Getting quotas for user 7daa9a32819e442e8c0713f128dbc827 and project 42aeec65dc86431ba3a607e0c425f130. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:22:46 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Going to run 1 instances... {{(pid=61933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:22:46 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:22:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-cb104aa2-ab74-4b14-8b30-58a7b00ebc40 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.028147 Apr 14 17:22:46 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 265/804] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:22:45 2023] POST /compute/v2.1/servers => generated 378 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:22:46 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-126fa515-2297-4aeb-9066-04781ae5c8d8 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:46 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-126fa515-2297-4aeb-9066-04781ae5c8d8 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:46 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-126fa515-2297-4aeb-9066-04781ae5c8d8 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daa9a32819e442e8c0713f128dbc827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42aeec65dc86431ba3a607e0c425f130', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:22:46 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-126fa515-2297-4aeb-9066-04781ae5c8d8 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9628e25-8292-4b41-87dd-e6149a31f768" status: 200 len: 1207 microversion: 2.1 time: 0.070042 Apr 14 17:22:46 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 272/805] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:22:46 2023] GET /compute/v2.1/servers/b9628e25-8292-4b41-87dd-e6149a31f768 => generated 1207 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:22:47 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:47 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:47 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Going to try to terminate instance {{(pid=61934) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:22:47 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-6d2efa11-90d8-435f-9e2e-874424179240 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" status: 204 len: 0 microversion: 2.1 time: 0.248364 Apr 14 17:22:47 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 269/806] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:22:47 2023] DELETE /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:22:47 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-f6ec76dd-b568-4c19-a64c-d5ec531a1875 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:22:47 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-f6ec76dd-b568-4c19-a64c-d5ec531a1875 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:22:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f6ec76dd-b568-4c19-a64c-d5ec531a1875 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f6ec76dd-b568-4c19-a64c-d5ec531a1875 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f6ec76dd-b568-4c19-a64c-d5ec531a1875 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f6ec76dd-b568-4c19-a64c-d5ec531a1875 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f6ec76dd-b568-4c19-a64c-d5ec531a1875 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:47 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f6ec76dd-b568-4c19-a64c-d5ec531a1875 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:47 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-2992a271-1cd8-470b-80e3-cbae7aa50dda req-11b38cf3-4f29-43d2-84f2-6cd32687b000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88", "name": "network-vif-plugged", "status": "completed", "tag": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:22:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2992a271-1cd8-470b-80e3-cbae7aa50dda req-11b38cf3-4f29-43d2-84f2-6cd32687b000 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2992a271-1cd8-470b-80e3-cbae7aa50dda req-11b38cf3-4f29-43d2-84f2-6cd32687b000 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2992a271-1cd8-470b-80e3-cbae7aa50dda req-11b38cf3-4f29-43d2-84f2-6cd32687b000 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:47 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-2992a271-1cd8-470b-80e3-cbae7aa50dda req-11b38cf3-4f29-43d2-84f2-6cd32687b000 service nova] Creating event network-vif-plugged:ff6f2e44-8051-46b5-9b63-46b5fcc6db6a for instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 on user Apr 14 17:22:47 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-2992a271-1cd8-470b-80e3-cbae7aa50dda req-11b38cf3-4f29-43d2-84f2-6cd32687b000 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035027 Apr 14 17:22:47 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 273/807] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:22:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:22:48 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-f6ec76dd-b568-4c19-a64c-d5ec531a1875 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0842f11b0499298e2af46ad659962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a92a4f922f442a88cfb86f8239e52ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:22:48 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-f6ec76dd-b568-4c19-a64c-d5ec531a1875 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" status: 200 len: 1542 microversion: 2.1 time: 0.444731 Apr 14 17:22:48 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 266/808] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:22:47 2023] GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 => generated 1542 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:22:49 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715", "name": "network-vif-unplugged", "status": "completed", "tag": "43e76338-e6dd-456e-b1e2-d2f7c150f14d"}, {"server_uuid": "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715", "name": "network-vif-plugged", "status": "completed", "tag": "43e76338-e6dd-456e-b1e2-d2f7c150f14d"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:22:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:49 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:49 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] Creating event network-vif-unplugged:43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 on user Apr 14 17:22:49 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] Creating event network-vif-plugged:43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 on user Apr 14 17:22:49 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-a9bffeb5-2a93-4c3c-89a5-9af541b2eb6d req-54b4a23d-df14-4504-be89-cc22f1af3930 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.049560 Apr 14 17:22:49 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 270/809] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:22:49 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:22:49 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:22:49 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-5d67b9bd-b92c-42aa-899e-7de5886793de req-8f39b78b-2dc9-4939-837a-d6704563d731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9628e25-8292-4b41-87dd-e6149a31f768", "tag": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:22:49 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5d67b9bd-b92c-42aa-899e-7de5886793de req-8f39b78b-2dc9-4939-837a-d6704563d731 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5d67b9bd-b92c-42aa-899e-7de5886793de req-8f39b78b-2dc9-4939-837a-d6704563d731 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:50 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5d67b9bd-b92c-42aa-899e-7de5886793de req-8f39b78b-2dc9-4939-837a-d6704563d731 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:50 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-351b92ad-1a8e-4b70-8675-b2ac603131ce req-585fc73f-a1e8-407a-ae4e-192387a970de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5ebe0f-81d3-4dbc-b55f-4c42d2857715", "name": "network-vif-deleted", "tag": "43e76338-e6dd-456e-b1e2-d2f7c150f14d"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:22:50 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-5d67b9bd-b92c-42aa-899e-7de5886793de req-8f39b78b-2dc9-4939-837a-d6704563d731 service nova] Creating event network-changed:8faddbf2-7a4e-4c78-856d-0d858d8b9cad for instance b9628e25-8292-4b41-87dd-e6149a31f768 on user Apr 14 17:22:50 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-5d67b9bd-b92c-42aa-899e-7de5886793de req-8f39b78b-2dc9-4939-837a-d6704563d731 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063696 Apr 14 17:22:50 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 274/810] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:22:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:22:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-351b92ad-1a8e-4b70-8675-b2ac603131ce req-585fc73f-a1e8-407a-ae4e-192387a970de service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-351b92ad-1a8e-4b70-8675-b2ac603131ce req-585fc73f-a1e8-407a-ae4e-192387a970de service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-351b92ad-1a8e-4b70-8675-b2ac603131ce req-585fc73f-a1e8-407a-ae4e-192387a970de service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:50 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-351b92ad-1a8e-4b70-8675-b2ac603131ce req-585fc73f-a1e8-407a-ae4e-192387a970de service nova] Creating event network-vif-deleted:43e76338-e6dd-456e-b1e2-d2f7c150f14d for instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 on user Apr 14 17:22:50 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-351b92ad-1a8e-4b70-8675-b2ac603131ce req-585fc73f-a1e8-407a-ae4e-192387a970de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046567 Apr 14 17:22:50 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 267/811] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:22:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:22:52 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-8eb97a56-d336-45af-9d99-fa6bb83c51dc req-fbe44649-84c1-4d2f-af91-9ac3df627a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9628e25-8292-4b41-87dd-e6149a31f768", "name": "network-vif-plugged", "status": "completed", "tag": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:22:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8eb97a56-d336-45af-9d99-fa6bb83c51dc req-fbe44649-84c1-4d2f-af91-9ac3df627a07 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8eb97a56-d336-45af-9d99-fa6bb83c51dc req-fbe44649-84c1-4d2f-af91-9ac3df627a07 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8eb97a56-d336-45af-9d99-fa6bb83c51dc req-fbe44649-84c1-4d2f-af91-9ac3df627a07 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:52 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-8eb97a56-d336-45af-9d99-fa6bb83c51dc req-fbe44649-84c1-4d2f-af91-9ac3df627a07 service nova] Creating event network-vif-plugged:8faddbf2-7a4e-4c78-856d-0d858d8b9cad for instance b9628e25-8292-4b41-87dd-e6149a31f768 on user Apr 14 17:22:52 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-8eb97a56-d336-45af-9d99-fa6bb83c51dc req-fbe44649-84c1-4d2f-af91-9ac3df627a07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032772 Apr 14 17:22:52 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 271/812] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:22:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:22:54 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-19dcac1d-c1be-44c5-a0d3-56c00e2c3f03 req-fb7e9912-a590-4f70-b71d-20bdfe006ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9628e25-8292-4b41-87dd-e6149a31f768", "name": "network-vif-plugged", "status": "completed", "tag": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:22:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-19dcac1d-c1be-44c5-a0d3-56c00e2c3f03 req-fb7e9912-a590-4f70-b71d-20bdfe006ebf service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:22:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-19dcac1d-c1be-44c5-a0d3-56c00e2c3f03 req-fb7e9912-a590-4f70-b71d-20bdfe006ebf service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:22:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-19dcac1d-c1be-44c5-a0d3-56c00e2c3f03 req-fb7e9912-a590-4f70-b71d-20bdfe006ebf service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:22:54 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-19dcac1d-c1be-44c5-a0d3-56c00e2c3f03 req-fb7e9912-a590-4f70-b71d-20bdfe006ebf service nova] Creating event network-vif-plugged:8faddbf2-7a4e-4c78-856d-0d858d8b9cad for instance b9628e25-8292-4b41-87dd-e6149a31f768 on user Apr 14 17:22:54 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-19dcac1d-c1be-44c5-a0d3-56c00e2c3f03 req-fb7e9912-a590-4f70-b71d-20bdfe006ebf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043801 Apr 14 17:22:54 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 275/813] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:22:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:23:00 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:00 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=8 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:00 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:00 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=22 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:00 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:23:00 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:23:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:00 user devstack@n-api.service[61933]: DEBUG nova.objects.instance [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'services' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=61933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:23:00 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-2bcfe942-c84d-403c-805c-59917ae0e15d tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments/a0e1588e-3447-4cc6-8740-d7a3b6af2807" status: 202 len: 0 microversion: 2.1 time: 0.187581 Apr 14 17:23:00 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 268/814] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:23:00 2023] DELETE /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments/a0e1588e-3447-4cc6-8740-d7a3b6af2807 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:23:00 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-7a3f50ba-7690-4fc6-81e0-3cdaad2b35c8 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:23:00 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-7a3f50ba-7690-4fc6-81e0-3cdaad2b35c8 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:23:00 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7a3f50ba-7690-4fc6-81e0-3cdaad2b35c8 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7a3f50ba-7690-4fc6-81e0-3cdaad2b35c8 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7a3f50ba-7690-4fc6-81e0-3cdaad2b35c8 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7a3f50ba-7690-4fc6-81e0-3cdaad2b35c8 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7a3f50ba-7690-4fc6-81e0-3cdaad2b35c8 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7a3f50ba-7690-4fc6-81e0-3cdaad2b35c8 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:00 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:00 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-7a3f50ba-7690-4fc6-81e0-3cdaad2b35c8 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058519 Apr 14 17:23:00 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 272/815] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:23:00 2023] GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:23:03 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-60e8acac-a805-4a71-b8ae-df9e40a9ec21 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:23:03 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-60e8acac-a805-4a71-b8ae-df9e40a9ec21 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:23:03 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=8 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:03 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-60e8acac-a805-4a71-b8ae-df9e40a9ec21 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-60e8acac-a805-4a71-b8ae-df9e40a9ec21 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-60e8acac-a805-4a71-b8ae-df9e40a9ec21 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-60e8acac-a805-4a71-b8ae-df9e40a9ec21 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-60e8acac-a805-4a71-b8ae-df9e40a9ec21 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-60e8acac-a805-4a71-b8ae-df9e40a9ec21 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:03 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:03 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-60e8acac-a805-4a71-b8ae-df9e40a9ec21 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/action" status: 202 len: 0 microversion: 2.87 time: 0.116944 Apr 14 17:23:03 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 276/816] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 17:23:03 2023] POST /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:23:03 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-3a62638d-5c62-4f78-a42f-a5f1f1862ccb tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:23:03 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-3a62638d-5c62-4f78-a42f-a5f1f1862ccb tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:23:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3a62638d-5c62-4f78-a42f-a5f1f1862ccb tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3a62638d-5c62-4f78-a42f-a5f1f1862ccb tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3a62638d-5c62-4f78-a42f-a5f1f1862ccb tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3a62638d-5c62-4f78-a42f-a5f1f1862ccb tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3a62638d-5c62-4f78-a42f-a5f1f1862ccb tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-3a62638d-5c62-4f78-a42f-a5f1f1862ccb tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:03 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-3a62638d-5c62-4f78-a42f-a5f1f1862ccb tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:23:03 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-3a62638d-5c62-4f78-a42f-a5f1f1862ccb tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:23:03 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-3a62638d-5c62-4f78-a42f-a5f1f1862ccb tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:23:03 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-3a62638d-5c62-4f78-a42f-a5f1f1862ccb tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" status: 200 len: 1762 microversion: 2.87 time: 0.386025 Apr 14 17:23:03 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 269/817] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:23:03 2023] GET /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 => generated 1762 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:23:03 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-a7fb09ad-cc57-4b74-ab26-b0d72c663ef4 req-1bd933ec-87a7-4e7a-88f5-da8cc1e5941a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3", "name": "network-vif-unplugged", "status": "completed", "tag": "9262ab81-5611-4d5e-b32b-082b3c4981fd"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:23:03 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a7fb09ad-cc57-4b74-ab26-b0d72c663ef4 req-1bd933ec-87a7-4e7a-88f5-da8cc1e5941a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:03 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a7fb09ad-cc57-4b74-ab26-b0d72c663ef4 req-1bd933ec-87a7-4e7a-88f5-da8cc1e5941a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:03 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a7fb09ad-cc57-4b74-ab26-b0d72c663ef4 req-1bd933ec-87a7-4e7a-88f5-da8cc1e5941a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:03 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-a7fb09ad-cc57-4b74-ab26-b0d72c663ef4 req-1bd933ec-87a7-4e7a-88f5-da8cc1e5941a service nova] Creating event network-vif-unplugged:9262ab81-5611-4d5e-b32b-082b3c4981fd for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 on user Apr 14 17:23:03 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-a7fb09ad-cc57-4b74-ab26-b0d72c663ef4 req-1bd933ec-87a7-4e7a-88f5-da8cc1e5941a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030061 Apr 14 17:23:03 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 273/818] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:23:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:23:05 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3", "name": "network-vif-plugged", "status": "completed", "tag": "9262ab81-5611-4d5e-b32b-082b3c4981fd"}, {"server_uuid": "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3", "name": "network-vif-plugged", "status": "completed", "tag": "9262ab81-5611-4d5e-b32b-082b3c4981fd"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:23:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:06 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] Creating event network-vif-plugged:9262ab81-5611-4d5e-b32b-082b3c4981fd for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 on user Apr 14 17:23:06 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] Creating event network-vif-plugged:9262ab81-5611-4d5e-b32b-082b3c4981fd for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 on user Apr 14 17:23:06 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-c67a778c-4b43-46e6-8bc0-dcd17ff956d6 req-abca44fc-6d84-47ec-8301-f4722a07b27d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032315 Apr 14 17:23:06 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 277/819] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:23:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:23:07 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b1bc5f02-42b1-4cc7-9c62-7b8d04f04e7a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:23:07 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-b1bc5f02-42b1-4cc7-9c62-7b8d04f04e7a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:23:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b1bc5f02-42b1-4cc7-9c62-7b8d04f04e7a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b1bc5f02-42b1-4cc7-9c62-7b8d04f04e7a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b1bc5f02-42b1-4cc7-9c62-7b8d04f04e7a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b1bc5f02-42b1-4cc7-9c62-7b8d04f04e7a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b1bc5f02-42b1-4cc7-9c62-7b8d04f04e7a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:07 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b1bc5f02-42b1-4cc7-9c62-7b8d04f04e7a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:07 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-b1bc5f02-42b1-4cc7-9c62-7b8d04f04e7a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090244 Apr 14 17:23:07 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 270/820] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:23:07 2023] GET /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:23:08 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-2e618c93-a28c-438a-9436-5548e53ae915 req-d0bb5b8d-49c8-4615-9ebb-19b57bfb1238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3", "name": "network-vif-plugged", "status": "completed", "tag": "9262ab81-5611-4d5e-b32b-082b3c4981fd"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:23:08 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-2e618c93-a28c-438a-9436-5548e53ae915 req-d0bb5b8d-49c8-4615-9ebb-19b57bfb1238 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:08 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-2e618c93-a28c-438a-9436-5548e53ae915 req-d0bb5b8d-49c8-4615-9ebb-19b57bfb1238 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:08 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-2e618c93-a28c-438a-9436-5548e53ae915 req-d0bb5b8d-49c8-4615-9ebb-19b57bfb1238 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:08 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-2e618c93-a28c-438a-9436-5548e53ae915 req-d0bb5b8d-49c8-4615-9ebb-19b57bfb1238 service nova] Creating event network-vif-plugged:9262ab81-5611-4d5e-b32b-082b3c4981fd for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 on user Apr 14 17:23:08 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-2e618c93-a28c-438a-9436-5548e53ae915 req-d0bb5b8d-49c8-4615-9ebb-19b57bfb1238 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029014 Apr 14 17:23:08 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 274/821] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:23:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:23:10 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-598adaf3-2fa0-41d1-9d66-90e66baa368e tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:23:10 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-598adaf3-2fa0-41d1-9d66-90e66baa368e tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:23:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-598adaf3-2fa0-41d1-9d66-90e66baa368e tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-598adaf3-2fa0-41d1-9d66-90e66baa368e tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-598adaf3-2fa0-41d1-9d66-90e66baa368e tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-598adaf3-2fa0-41d1-9d66-90e66baa368e tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-598adaf3-2fa0-41d1-9d66-90e66baa368e tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-598adaf3-2fa0-41d1-9d66-90e66baa368e tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:10 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-598adaf3-2fa0-41d1-9d66-90e66baa368e tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c while it is in vm_state rescued Apr 14 17:23:10 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-598adaf3-2fa0-41d1-9d66-90e66baa368e tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Request method failure captured: Apr 14 17:23:10 user devstack@n-api.service[61935]: request: DELETE /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/os-volume_attachments/5380e47e-86ce-482e-b6d7-b756348399d5 HTTP/1.1 Apr 14 17:23:10 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:23:10 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:23:10 user devstack@n-api.service[61935]: Connection: close Apr 14 17:23:10 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:23:10 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:23:10 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:23:10 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:23:10 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:23:10 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYkVBClkxIawkM1nyUWU7TVOYrVEr-N9nAU0PhEuzEE_-YQvgNuTftESHpChD4G1-5d4DpIA7CkgTQ_FGsRsbu8wQIBOC8wC2te9X-DHMsSVpuMD-5ffx2BY9NFTVd25q-U7totKdOrSDVAhHx_Uazr6ZqvpJMFsWKYTM7zuiuFUAR8 Apr 14 17:23:10 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:23:10 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:23:10 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:23:10 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:23:10 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:23:10 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:23:10 user devstack@n-api.service[61935]: X-Project-Id: 070c6b9f620548b183904d1971f35752 Apr 14 17:23:10 user devstack@n-api.service[61935]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2056337871 Apr 14 17:23:10 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:23:10 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:23:10 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/070c6b9f620548b183904d1971f35752"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/070c6b9f620548b183904d1971f35752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/070c6b9f620548b183904d1971f35752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:23:10 user devstack@n-api.service[61935]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2056337871 Apr 14 17:23:10 user devstack@n-api.service[61935]: X-Tenant-Id: 070c6b9f620548b183904d1971f35752 Apr 14 17:23:10 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2056337871 Apr 14 17:23:10 user devstack@n-api.service[61935]: X-User: tempest-ServerRescueNegativeTestJSON-2056337871-project-member Apr 14 17:23:10 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:23:10 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:23:10 user devstack@n-api.service[61935]: X-User-Id: 2434278fe61447fab1f5a930aa16a1de Apr 14 17:23:10 user devstack@n-api.service[61935]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2056337871-project-member Apr 14 17:23:10 user devstack@n-api.service[61935]: method: > Apr 14 17:23:10 user devstack@n-api.service[61935]: exception: Cannot 'detach_volume' instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c while it is in vm_state rescued Apr 14 17:23:10 user devstack@n-api.service[61935]: action_args: {'server_id': '0cf7a0ce-87a0-4a24-8410-26d056e8816c', 'id': '5380e47e-86ce-482e-b6d7-b756348399d5'} Apr 14 17:23:10 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c while it is in vm_state rescued Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c while it is in vm_state rescued Apr 14 17:23:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:23:10 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-598adaf3-2fa0-41d1-9d66-90e66baa368e tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Returning 409 to user: Cannot 'detach_volume' instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c while it is in vm_state rescued {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:23:10 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-598adaf3-2fa0-41d1-9d66-90e66baa368e tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/os-volume_attachments/5380e47e-86ce-482e-b6d7-b756348399d5" status: 409 len: 152 microversion: 2.1 time: 0.106804 Apr 14 17:23:10 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 278/822] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:23:10 2023] DELETE /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/os-volume_attachments/5380e47e-86ce-482e-b6d7-b756348399d5 => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 17:23:10 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-acc9c38d-acfe-4bdc-81b4-97168353358a tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:23:10 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-acc9c38d-acfe-4bdc-81b4-97168353358a tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:23:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-acc9c38d-acfe-4bdc-81b4-97168353358a tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-acc9c38d-acfe-4bdc-81b4-97168353358a tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-acc9c38d-acfe-4bdc-81b4-97168353358a tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-acc9c38d-acfe-4bdc-81b4-97168353358a tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-acc9c38d-acfe-4bdc-81b4-97168353358a tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-acc9c38d-acfe-4bdc-81b4-97168353358a tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:10 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-acc9c38d-acfe-4bdc-81b4-97168353358a tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/action" status: 202 len: 0 microversion: 2.1 time: 0.096983 Apr 14 17:23:10 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 271/823] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:23:10 2023] POST /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:23:10 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-7ba86900-1a48-4ec9-8134-1599ea428c44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:23:10 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-7ba86900-1a48-4ec9-8134-1599ea428c44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:23:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7ba86900-1a48-4ec9-8134-1599ea428c44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7ba86900-1a48-4ec9-8134-1599ea428c44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7ba86900-1a48-4ec9-8134-1599ea428c44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7ba86900-1a48-4ec9-8134-1599ea428c44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7ba86900-1a48-4ec9-8134-1599ea428c44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-7ba86900-1a48-4ec9-8134-1599ea428c44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:10 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-7ba86900-1a48-4ec9-8134-1599ea428c44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:23:10 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-7ba86900-1a48-4ec9-8134-1599ea428c44 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c" status: 200 len: 1710 microversion: 2.1 time: 0.258269 Apr 14 17:23:10 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 275/824] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:23:10 2023] GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c => generated 1710 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:23:11 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-66f176fc-f85e-4d27-9faf-f1429cbdcd81 req-e36097c4-d046-4178-b271-0e535eff2b7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "name": "network-vif-unplugged", "status": "completed", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:23:11 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-66f176fc-f85e-4d27-9faf-f1429cbdcd81 req-e36097c4-d046-4178-b271-0e535eff2b7b service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:11 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-66f176fc-f85e-4d27-9faf-f1429cbdcd81 req-e36097c4-d046-4178-b271-0e535eff2b7b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:11 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-66f176fc-f85e-4d27-9faf-f1429cbdcd81 req-e36097c4-d046-4178-b271-0e535eff2b7b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:11 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-66f176fc-f85e-4d27-9faf-f1429cbdcd81 req-e36097c4-d046-4178-b271-0e535eff2b7b service nova] Creating event network-vif-unplugged:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:23:11 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-66f176fc-f85e-4d27-9faf-f1429cbdcd81 req-e36097c4-d046-4178-b271-0e535eff2b7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036228 Apr 14 17:23:11 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 279/825] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:23:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:23:12 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-2010281861"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:23:12 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:23:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:13 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-891f559a-d8ea-45ae-ada6-d8b58e67df27 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "POST /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682/action" status: 202 len: 0 microversion: 2.1 time: 1.022026 Apr 14 17:23:13 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 272/826] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:23:12 2023] POST /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682/action => generated 0 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 17:23:13 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "name": "network-vif-plugged", "status": "completed", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}, {"server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "name": "network-vif-plugged", "status": "completed", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:23:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:13 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] Creating event network-vif-plugged:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:23:13 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] Creating event network-vif-plugged:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:23:13 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-bcdf50f7-35e2-4228-ac10-fb77b5d14b7e req-0be1c81f-c85d-455e-a987-5f76183787fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033051 Apr 14 17:23:13 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 276/827] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:23:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:23:15 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-5e0acb1f-0c6a-417b-94a1-b783b396e231 req-961a8908-c999-449c-81e5-35087ea66b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "name": "network-vif-plugged", "status": "completed", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:23:15 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5e0acb1f-0c6a-417b-94a1-b783b396e231 req-961a8908-c999-449c-81e5-35087ea66b6d service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:15 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5e0acb1f-0c6a-417b-94a1-b783b396e231 req-961a8908-c999-449c-81e5-35087ea66b6d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:15 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-5e0acb1f-0c6a-417b-94a1-b783b396e231 req-961a8908-c999-449c-81e5-35087ea66b6d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:15 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-5e0acb1f-0c6a-417b-94a1-b783b396e231 req-961a8908-c999-449c-81e5-35087ea66b6d service nova] Creating event network-vif-plugged:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:23:15 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-5e0acb1f-0c6a-417b-94a1-b783b396e231 req-961a8908-c999-449c-81e5-35087ea66b6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029474 Apr 14 17:23:15 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 280/828] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:23:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:23:21 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1710972168", "imageRef": "b82a7509-0a29-4cd7-84f4-661d4214f0b1", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1893968129", "security_groups": [{"name": "tempest-secgroup-smoke-846815827"}], "networks": [{"uuid": "f910e955-f75a-46aa-8d8a-ef2c21f4e98b"}]}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:23:22 user devstack@n-api.service[61933]: DEBUG nova.network.neutron [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] validate_networks() for [('f910e955-f75a-46aa-8d8a-ef2c21f4e98b', None, None, None, None, None)] {{(pid=61933) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:23:22 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Flavor limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:23:22 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Image limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:23:22 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Flavor pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:23:22 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Image pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:23:22 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:23:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:22 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Getting quotas for project f7ab08f97dd54832a7cc975934b1b69f. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:23:22 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Getting quotas for user b8ea39d187c842788168909de203455e and project f7ab08f97dd54832a7cc975934b1b69f. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:23:22 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Going to run 1 instances... {{(pid=61933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:23:22 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b82a7509-0a29-4cd7-84f4-661d4214f0b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:23:23 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-29ccdc44-4ad5-43f4-b557-7b9458174924 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.020558 Apr 14 17:23:23 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 273/829] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:23:21 2023] POST /compute/v2.1/servers => generated 403 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:23:23 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-6b1c1b7e-a085-4b9a-a2bf-7de79a27ac65 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:23:23 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-6b1c1b7e-a085-4b9a-a2bf-7de79a27ac65 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:23:23 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-6b1c1b7e-a085-4b9a-a2bf-7de79a27ac65 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ea39d187c842788168909de203455e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ab08f97dd54832a7cc975934b1b69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:23:23 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-6b1c1b7e-a085-4b9a-a2bf-7de79a27ac65 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859" status: 200 len: 1237 microversion: 2.1 time: 0.077331 Apr 14 17:23:23 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 277/830] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:23:23 2023] GET /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859 => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:23:25 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=9 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:25 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:25 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-706e83d4-ec98-47c5-b6d9-1184c13212b3 req-b9e17c84-4b19-4a4b-8fd2-70b246cfc6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1607fec-229c-4bce-b9d4-b8b01a650859", "tag": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:23:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-706e83d4-ec98-47c5-b6d9-1184c13212b3 req-b9e17c84-4b19-4a4b-8fd2-70b246cfc6a8 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-706e83d4-ec98-47c5-b6d9-1184c13212b3 req-b9e17c84-4b19-4a4b-8fd2-70b246cfc6a8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-706e83d4-ec98-47c5-b6d9-1184c13212b3 req-b9e17c84-4b19-4a4b-8fd2-70b246cfc6a8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:25 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-706e83d4-ec98-47c5-b6d9-1184c13212b3 req-b9e17c84-4b19-4a4b-8fd2-70b246cfc6a8 service nova] Creating event network-changed:5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 for instance f1607fec-229c-4bce-b9d4-b8b01a650859 on user Apr 14 17:23:25 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-706e83d4-ec98-47c5-b6d9-1184c13212b3 req-b9e17c84-4b19-4a4b-8fd2-70b246cfc6a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038899 Apr 14 17:23:25 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 281/831] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:23:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:23:27 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-fc431f24-a268-4b01-8a5d-1d3898b319e8 req-e0fa3810-a0d9-43d7-913d-7224cb9a7b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1607fec-229c-4bce-b9d4-b8b01a650859", "name": "network-vif-plugged", "status": "completed", "tag": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:23:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-fc431f24-a268-4b01-8a5d-1d3898b319e8 req-e0fa3810-a0d9-43d7-913d-7224cb9a7b70 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-fc431f24-a268-4b01-8a5d-1d3898b319e8 req-e0fa3810-a0d9-43d7-913d-7224cb9a7b70 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-fc431f24-a268-4b01-8a5d-1d3898b319e8 req-e0fa3810-a0d9-43d7-913d-7224cb9a7b70 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:27 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-fc431f24-a268-4b01-8a5d-1d3898b319e8 req-e0fa3810-a0d9-43d7-913d-7224cb9a7b70 service nova] Creating event network-vif-plugged:5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 for instance f1607fec-229c-4bce-b9d4-b8b01a650859 on user Apr 14 17:23:27 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-fc431f24-a268-4b01-8a5d-1d3898b319e8 req-e0fa3810-a0d9-43d7-913d-7224cb9a7b70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044005 Apr 14 17:23:27 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 274/832] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:23:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:23:30 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-b60c6e04-fa3f-49d7-9b28-349b8581fc83 req-3a8311a6-63e9-4056-8ad5-5d73cbbef327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1607fec-229c-4bce-b9d4-b8b01a650859", "name": "network-vif-plugged", "status": "completed", "tag": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:23:30 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=17 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:30 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b60c6e04-fa3f-49d7-9b28-349b8581fc83 req-3a8311a6-63e9-4056-8ad5-5d73cbbef327 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:30 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b60c6e04-fa3f-49d7-9b28-349b8581fc83 req-3a8311a6-63e9-4056-8ad5-5d73cbbef327 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:30 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b60c6e04-fa3f-49d7-9b28-349b8581fc83 req-3a8311a6-63e9-4056-8ad5-5d73cbbef327 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:30 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-b60c6e04-fa3f-49d7-9b28-349b8581fc83 req-3a8311a6-63e9-4056-8ad5-5d73cbbef327 service nova] Creating event network-vif-plugged:5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 for instance f1607fec-229c-4bce-b9d4-b8b01a650859 on user Apr 14 17:23:30 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-b60c6e04-fa3f-49d7-9b28-349b8581fc83 req-3a8311a6-63e9-4056-8ad5-5d73cbbef327 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032774 Apr 14 17:23:30 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 278/833] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:23:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:23:30 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-026ba082-48b3-40fe-a019-bca2e85cbf0c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:23:30 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-026ba082-48b3-40fe-a019-bca2e85cbf0c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:23:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-026ba082-48b3-40fe-a019-bca2e85cbf0c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-026ba082-48b3-40fe-a019-bca2e85cbf0c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-026ba082-48b3-40fe-a019-bca2e85cbf0c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-026ba082-48b3-40fe-a019-bca2e85cbf0c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-026ba082-48b3-40fe-a019-bca2e85cbf0c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-026ba082-48b3-40fe-a019-bca2e85cbf0c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:30 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-026ba082-48b3-40fe-a019-bca2e85cbf0c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:23:30 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-026ba082-48b3-40fe-a019-bca2e85cbf0c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" status: 200 len: 1538 microversion: 2.1 time: 0.217068 Apr 14 17:23:30 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 282/834] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:23:30 2023] GET /compute/v2.1/servers/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 => generated 1538 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:23:36 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:36 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:36 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-e086eff6-7aa9-4f6e-907a-c202ffb1aff4 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:23:36 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-e086eff6-7aa9-4f6e-907a-c202ffb1aff4 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:23:36 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e086eff6-7aa9-4f6e-907a-c202ffb1aff4 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e086eff6-7aa9-4f6e-907a-c202ffb1aff4 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e086eff6-7aa9-4f6e-907a-c202ffb1aff4 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e086eff6-7aa9-4f6e-907a-c202ffb1aff4 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e086eff6-7aa9-4f6e-907a-c202ffb1aff4 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e086eff6-7aa9-4f6e-907a-c202ffb1aff4 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:36 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:37 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-e086eff6-7aa9-4f6e-907a-c202ffb1aff4 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daa9a32819e442e8c0713f128dbc827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42aeec65dc86431ba3a607e0c425f130', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:23:37 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-e086eff6-7aa9-4f6e-907a-c202ffb1aff4 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9628e25-8292-4b41-87dd-e6149a31f768" status: 200 len: 1484 microversion: 2.1 time: 0.300681 Apr 14 17:23:37 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 275/835] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:23:36 2023] GET /compute/v2.1/servers/b9628e25-8292-4b41-87dd-e6149a31f768 => generated 1484 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:23:38 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:38 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-04f813dc-1ad9-4e96-8b20-dcf7b1d4ceb8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:23:38 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-04f813dc-1ad9-4e96-8b20-dcf7b1d4ceb8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] [instance: 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:23:38 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=16 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-04f813dc-1ad9-4e96-8b20-dcf7b1d4ceb8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-04f813dc-1ad9-4e96-8b20-dcf7b1d4ceb8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-04f813dc-1ad9-4e96-8b20-dcf7b1d4ceb8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-04f813dc-1ad9-4e96-8b20-dcf7b1d4ceb8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-04f813dc-1ad9-4e96-8b20-dcf7b1d4ceb8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:38 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-04f813dc-1ad9-4e96-8b20-dcf7b1d4ceb8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:38 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-04f813dc-1ad9-4e96-8b20-dcf7b1d4ceb8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] HTTP exception thrown: Instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 could not be found. Apr 14 17:23:38 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-04f813dc-1ad9-4e96-8b20-dcf7b1d4ceb8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Request method failure captured: Apr 14 17:23:38 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 HTTP/1.1 Apr 14 17:23:38 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:23:38 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:23:38 user devstack@n-api.service[61934]: Connection: close Apr 14 17:23:38 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:23:38 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:23:38 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:23:38 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:23:38 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:23:38 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYlH8oeecSNmWpcptJ7XQIg_czFAdoxZlEn7n9bZMWzl2Cey_zb44KiBPB5hBZCJuPRxZS0tzBAMtnKhqqdQ2MYOjUj8RmHi4TQSQ-tS3z_yl5OsJr6EVti0XIm87vd_6aqqJws-eEBXEZwCnCAh-boDeWVkYEkG4ObXm2GgFk8-T-M Apr 14 17:23:38 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:23:38 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:23:38 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:23:38 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:23:38 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:23:38 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:23:38 user devstack@n-api.service[61934]: X-Project-Id: 0a92a4f922f442a88cfb86f8239e52ac Apr 14 17:23:38 user devstack@n-api.service[61934]: X-Project-Name: tempest-TestMinimumBasicScenario-1645387059 Apr 14 17:23:38 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:23:38 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:23:38 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a92a4f922f442a88cfb86f8239e52ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a92a4f922f442a88cfb86f8239e52ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0a92a4f922f442a88cfb86f8239e52ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:23:38 user devstack@n-api.service[61934]: X-Tenant: tempest-TestMinimumBasicScenario-1645387059 Apr 14 17:23:38 user devstack@n-api.service[61934]: X-Tenant-Id: 0a92a4f922f442a88cfb86f8239e52ac Apr 14 17:23:38 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1645387059 Apr 14 17:23:38 user devstack@n-api.service[61934]: X-User: tempest-TestMinimumBasicScenario-1645387059-project-member Apr 14 17:23:38 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:23:38 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:23:38 user devstack@n-api.service[61934]: X-User-Id: 4bd0842f11b0499298e2af46ad659962 Apr 14 17:23:38 user devstack@n-api.service[61934]: X-User-Name: tempest-TestMinimumBasicScenario-1645387059-project-member Apr 14 17:23:38 user devstack@n-api.service[61934]: method: > Apr 14 17:23:38 user devstack@n-api.service[61934]: exception: Instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 could not be found. Apr 14 17:23:38 user devstack@n-api.service[61934]: action_args: {'id': '6a5ebe0f-81d3-4dbc-b55f-4c42d2857715'} Apr 14 17:23:38 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 could not be found. Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 could not be found. Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 could not be found. Apr 14 17:23:38 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:23:38 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-04f813dc-1ad9-4e96-8b20-dcf7b1d4ceb8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Returning 404 to user: Instance 6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:23:38 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-04f813dc-1ad9-4e96-8b20-dcf7b1d4ceb8 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715" status: 404 len: 111 microversion: 2.1 time: 0.036597 Apr 14 17:23:38 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 279/836] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:23:38 2023] GET /compute/v2.1/servers/6a5ebe0f-81d3-4dbc-b55f-4c42d2857715 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:23:38 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-fc0e4563-d139-495e-a950-f9c29b936695 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] Calling method '.version_select at 0x7fe19cc2c820>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:23:38 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-fc0e4563-d139-495e-a950-f9c29b936695 tempest-TestMinimumBasicScenario-1645387059 tempest-TestMinimumBasicScenario-1645387059-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1307984235" status: 202 len: 0 microversion: 2.1 time: 0.022485 Apr 14 17:23:38 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 283/837] 10.0.0.210 () {62 vars in 1349 bytes} [Fri Apr 14 17:23:38 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1307984235 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:23:50 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-1c737586-09e0-4e29-8dcc-389a54c68b00 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:23:50 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-1c737586-09e0-4e29-8dcc-389a54c68b00 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:23:50 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:50 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=5 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1c737586-09e0-4e29-8dcc-389a54c68b00 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1c737586-09e0-4e29-8dcc-389a54c68b00 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1c737586-09e0-4e29-8dcc-389a54c68b00 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1c737586-09e0-4e29-8dcc-389a54c68b00 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1c737586-09e0-4e29-8dcc-389a54c68b00 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:50 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1c737586-09e0-4e29-8dcc-389a54c68b00 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:50 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-1c737586-09e0-4e29-8dcc-389a54c68b00 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052780 Apr 14 17:23:50 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 276/838] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:23:50 2023] GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:23:53 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-b6173e7d-b5ab-47fc-849e-b6cb4435d2ee tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:23:53 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-b6173e7d-b5ab-47fc-849e-b6cb4435d2ee tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:23:53 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:53 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b6173e7d-b5ab-47fc-849e-b6cb4435d2ee tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b6173e7d-b5ab-47fc-849e-b6cb4435d2ee tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b6173e7d-b5ab-47fc-849e-b6cb4435d2ee tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b6173e7d-b5ab-47fc-849e-b6cb4435d2ee tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b6173e7d-b5ab-47fc-849e-b6cb4435d2ee tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:53 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b6173e7d-b5ab-47fc-849e-b6cb4435d2ee tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:53 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-b6173e7d-b5ab-47fc-849e-b6cb4435d2ee tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:23:53 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-b6173e7d-b5ab-47fc-849e-b6cb4435d2ee tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:23:53 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-b6173e7d-b5ab-47fc-849e-b6cb4435d2ee tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:23:53 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-b6173e7d-b5ab-47fc-849e-b6cb4435d2ee tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" status: 200 len: 1768 microversion: 2.87 time: 0.256338 Apr 14 17:23:53 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 280/839] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:23:53 2023] GET /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 => generated 1768 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:23:54 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=8 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:54 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:23:54 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e828e55a-f155-442c-a964-8c7037b11c3f"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:23:54 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:23:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:23:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:23:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:23:54 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-265154a8-27bb-43c9-9e6e-d7b8aa3ace72 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "POST /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303564 Apr 14 17:23:54 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 284/840] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:23:54 2023] POST /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:24:00 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-6791bfb8-12f1-404c-9038-adc29ef286a5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:24:00 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-6791bfb8-12f1-404c-9038-adc29ef286a5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:24:00 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:24:00 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:24:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6791bfb8-12f1-404c-9038-adc29ef286a5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6791bfb8-12f1-404c-9038-adc29ef286a5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6791bfb8-12f1-404c-9038-adc29ef286a5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6791bfb8-12f1-404c-9038-adc29ef286a5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6791bfb8-12f1-404c-9038-adc29ef286a5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:00 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6791bfb8-12f1-404c-9038-adc29ef286a5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:00 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-6791bfb8-12f1-404c-9038-adc29ef286a5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:24:00 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-6791bfb8-12f1-404c-9038-adc29ef286a5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c" status: 200 len: 1716 microversion: 2.1 time: 0.300243 Apr 14 17:24:00 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 277/841] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:24:00 2023] GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c => generated 1716 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:24:02 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:24:02 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:24:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:02 user devstack@n-api.service[61934]: DEBUG nova.objects.instance [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'services' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=61934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:24:02 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-2ff9a9d2-cb08-4719-a153-675b348c3ef4 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments/e828e55a-f155-442c-a964-8c7037b11c3f" status: 202 len: 0 microversion: 2.1 time: 0.155196 Apr 14 17:24:02 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 281/842] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:24:02 2023] DELETE /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments/e828e55a-f155-442c-a964-8c7037b11c3f => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:24:02 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-dc9c7e98-b295-494d-8212-7b2cc8861b69 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:24:02 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-dc9c7e98-b295-494d-8212-7b2cc8861b69 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:24:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-dc9c7e98-b295-494d-8212-7b2cc8861b69 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-dc9c7e98-b295-494d-8212-7b2cc8861b69 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-dc9c7e98-b295-494d-8212-7b2cc8861b69 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-dc9c7e98-b295-494d-8212-7b2cc8861b69 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-dc9c7e98-b295-494d-8212-7b2cc8861b69 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-dc9c7e98-b295-494d-8212-7b2cc8861b69 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-dc9c7e98-b295-494d-8212-7b2cc8861b69 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049863 Apr 14 17:24:02 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 285/843] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:24:02 2023] GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:24:13 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-44a7ffca-a4a8-4f73-800d-fec0e504739f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:24:13 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-44a7ffca-a4a8-4f73-800d-fec0e504739f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:24:13 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:24:13 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:24:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-44a7ffca-a4a8-4f73-800d-fec0e504739f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-44a7ffca-a4a8-4f73-800d-fec0e504739f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-44a7ffca-a4a8-4f73-800d-fec0e504739f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-44a7ffca-a4a8-4f73-800d-fec0e504739f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-44a7ffca-a4a8-4f73-800d-fec0e504739f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-44a7ffca-a4a8-4f73-800d-fec0e504739f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:13 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-44a7ffca-a4a8-4f73-800d-fec0e504739f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ea39d187c842788168909de203455e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ab08f97dd54832a7cc975934b1b69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:24:13 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-44a7ffca-a4a8-4f73-800d-fec0e504739f tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859" status: 200 len: 1537 microversion: 2.1 time: 0.254689 Apr 14 17:24:13 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 278/844] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:24:13 2023] GET /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859 => generated 1537 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:24:30 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:24:30 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:24:30 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-09359411-42c5-46a2-b53e-9d68975f1ec2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:24:30 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-09359411-42c5-46a2-b53e-9d68975f1ec2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:24:30 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-09359411-42c5-46a2-b53e-9d68975f1ec2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:30 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-09359411-42c5-46a2-b53e-9d68975f1ec2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:30 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-09359411-42c5-46a2-b53e-9d68975f1ec2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:30 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-09359411-42c5-46a2-b53e-9d68975f1ec2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:30 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-09359411-42c5-46a2-b53e-9d68975f1ec2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:30 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-09359411-42c5-46a2-b53e-9d68975f1ec2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:31 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-09359411-42c5-46a2-b53e-9d68975f1ec2 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.489198 Apr 14 17:24:31 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 282/845] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 17:24:30 2023] GET /compute/v2.1/servers/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88/os-interface => generated 283 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:24:31 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-3a6df55f-f27d-4129-b960-507405798c28 req-d6bd8fc2-9715-4d08-ad3a-e5e50b3a81f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88", "tag": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:24:31 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:24:31 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:24:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3a6df55f-f27d-4129-b960-507405798c28 req-d6bd8fc2-9715-4d08-ad3a-e5e50b3a81f0 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3a6df55f-f27d-4129-b960-507405798c28 req-d6bd8fc2-9715-4d08-ad3a-e5e50b3a81f0 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3a6df55f-f27d-4129-b960-507405798c28 req-d6bd8fc2-9715-4d08-ad3a-e5e50b3a81f0 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:31 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-3a6df55f-f27d-4129-b960-507405798c28 req-d6bd8fc2-9715-4d08-ad3a-e5e50b3a81f0 service nova] Creating event network-changed:ff6f2e44-8051-46b5-9b63-46b5fcc6db6a for instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 on user Apr 14 17:24:31 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-3a6df55f-f27d-4129-b960-507405798c28 req-d6bd8fc2-9715-4d08-ad3a-e5e50b3a81f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040477 Apr 14 17:24:31 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 286/846] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:24:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:24:35 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1884229091", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "187c0a7b-9043-4eac-8ad7-2c72b6f23d4d"}], "security_groups": [{"name": "tempest-securitygroup--1580043032"}], "key_name": "tempest-keypair-310941958", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "6f629cce-a595-45d8-9afe-0f617ea75a87", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:24:35 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:24:35 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:24:35 user devstack@n-api.service[61933]: DEBUG nova.network.neutron [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] validate_networks() for [('187c0a7b-9043-4eac-8ad7-2c72b6f23d4d', None, None, None, None, None)] {{(pid=61933) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:24:36 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:24:36 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:24:36 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:24:36 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:24:36 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:24:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:36 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:36 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting quotas for project 978cd1b4b6434b298731b01dac02591c. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:24:36 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting quotas for user a22398c18fcc48aca2f0f9691f1c1143 and project 978cd1b4b6434b298731b01dac02591c. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:24:36 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Going to run 1 instances... {{(pid=61933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:24:36 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6f629cce-a595-45d8-9afe-0f617ea75a87',volume_size=None,volume_type=None)] {{(pid=61933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:24:36 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-aca8ce1e-b7e2-4fb8-8f4e-ade5f9e183d4 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.130517 Apr 14 17:24:36 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 279/847] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:24:35 2023] POST /compute/v2.1/servers => generated 404 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:24:36 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-6fc46f56-6fc9-4b68-afda-728b9fa4211c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:24:36 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-6fc46f56-6fc9-4b68-afda-728b9fa4211c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:24:36 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-6fc46f56-6fc9-4b68-afda-728b9fa4211c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:24:36 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-6fc46f56-6fc9-4b68-afda-728b9fa4211c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752" status: 200 len: 1075 microversion: 2.1 time: 0.102124 Apr 14 17:24:36 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 283/848] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:24:36 2023] GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752 => generated 1075 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:24:40 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-6c31d097-5300-4edb-93b0-c4510dce206b req-4654da50-4d58-4beb-a68e-be2d005281a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66599df0-d961-404f-9573-fe0289019752", "tag": "b85a290c-1e7e-4f74-8590-be96f453decf"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:24:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-6c31d097-5300-4edb-93b0-c4510dce206b req-4654da50-4d58-4beb-a68e-be2d005281a8 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-6c31d097-5300-4edb-93b0-c4510dce206b req-4654da50-4d58-4beb-a68e-be2d005281a8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:40 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-6c31d097-5300-4edb-93b0-c4510dce206b req-4654da50-4d58-4beb-a68e-be2d005281a8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:40 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-6c31d097-5300-4edb-93b0-c4510dce206b req-4654da50-4d58-4beb-a68e-be2d005281a8 service nova] Creating event network-changed:b85a290c-1e7e-4f74-8590-be96f453decf for instance 66599df0-d961-404f-9573-fe0289019752 on user Apr 14 17:24:40 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-6c31d097-5300-4edb-93b0-c4510dce206b req-4654da50-4d58-4beb-a68e-be2d005281a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095718 Apr 14 17:24:40 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 287/849] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:24:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:24:44 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:24:44 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:24:44 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:44 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:44 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:44 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:44 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:44 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:44 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Going to try to terminate instance {{(pid=61933) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:24:44 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-c6dc4e38-507b-4020-913c-36467348ecf1 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b9628e25-8292-4b41-87dd-e6149a31f768" status: 204 len: 0 microversion: 2.1 time: 0.146602 Apr 14 17:24:44 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 280/850] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:24:44 2023] DELETE /compute/v2.1/servers/b9628e25-8292-4b41-87dd-e6149a31f768 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:24:44 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-0ecd6eb9-cbb2-4be4-a0b9-c47f6854a775 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:24:44 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-0ecd6eb9-cbb2-4be4-a0b9-c47f6854a775 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:24:44 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:24:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0ecd6eb9-cbb2-4be4-a0b9-c47f6854a775 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0ecd6eb9-cbb2-4be4-a0b9-c47f6854a775 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0ecd6eb9-cbb2-4be4-a0b9-c47f6854a775 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0ecd6eb9-cbb2-4be4-a0b9-c47f6854a775 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0ecd6eb9-cbb2-4be4-a0b9-c47f6854a775 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0ecd6eb9-cbb2-4be4-a0b9-c47f6854a775 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:44 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-67b49170-2318-4f3b-83e9-eb4c09a60667 req-9647a488-4821-424a-88c4-899f589fb035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9628e25-8292-4b41-87dd-e6149a31f768", "name": "network-vif-unplugged", "status": "completed", "tag": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:24:44 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-67b49170-2318-4f3b-83e9-eb4c09a60667 req-9647a488-4821-424a-88c4-899f589fb035 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:44 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-67b49170-2318-4f3b-83e9-eb4c09a60667 req-9647a488-4821-424a-88c4-899f589fb035 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:44 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-67b49170-2318-4f3b-83e9-eb4c09a60667 req-9647a488-4821-424a-88c4-899f589fb035 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:44 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-67b49170-2318-4f3b-83e9-eb4c09a60667 req-9647a488-4821-424a-88c4-899f589fb035 service nova] Creating event network-vif-unplugged:8faddbf2-7a4e-4c78-856d-0d858d8b9cad for instance b9628e25-8292-4b41-87dd-e6149a31f768 on user Apr 14 17:24:44 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-67b49170-2318-4f3b-83e9-eb4c09a60667 req-9647a488-4821-424a-88c4-899f589fb035 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034177 Apr 14 17:24:44 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 288/851] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:24:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:24:44 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-0ecd6eb9-cbb2-4be4-a0b9-c47f6854a775 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daa9a32819e442e8c0713f128dbc827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42aeec65dc86431ba3a607e0c425f130', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:24:44 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-0ecd6eb9-cbb2-4be4-a0b9-c47f6854a775 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9628e25-8292-4b41-87dd-e6149a31f768" status: 200 len: 1490 microversion: 2.1 time: 0.315330 Apr 14 17:24:44 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 284/852] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:24:44 2023] GET /compute/v2.1/servers/b9628e25-8292-4b41-87dd-e6149a31f768 => generated 1490 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:24:46 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-b6443e18-ec50-4ec2-926c-666f7e644f99 req-851022c5-4fe7-4a53-b3ba-21c2bb3e4bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9628e25-8292-4b41-87dd-e6149a31f768", "name": "network-vif-plugged", "status": "completed", "tag": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad"}, {"server_uuid": "b9628e25-8292-4b41-87dd-e6149a31f768", "name": "network-vif-deleted", "tag": "8faddbf2-7a4e-4c78-856d-0d858d8b9cad"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:24:46 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:24:46 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:24:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-b6443e18-ec50-4ec2-926c-666f7e644f99 req-851022c5-4fe7-4a53-b3ba-21c2bb3e4bc3 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-b6443e18-ec50-4ec2-926c-666f7e644f99 req-851022c5-4fe7-4a53-b3ba-21c2bb3e4bc3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-b6443e18-ec50-4ec2-926c-666f7e644f99 req-851022c5-4fe7-4a53-b3ba-21c2bb3e4bc3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-b6443e18-ec50-4ec2-926c-666f7e644f99 req-851022c5-4fe7-4a53-b3ba-21c2bb3e4bc3 service nova] Creating event network-vif-plugged:8faddbf2-7a4e-4c78-856d-0d858d8b9cad for instance b9628e25-8292-4b41-87dd-e6149a31f768 on user Apr 14 17:24:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-b6443e18-ec50-4ec2-926c-666f7e644f99 req-851022c5-4fe7-4a53-b3ba-21c2bb3e4bc3 service nova] Creating event network-vif-deleted:8faddbf2-7a4e-4c78-856d-0d858d8b9cad for instance b9628e25-8292-4b41-87dd-e6149a31f768 on user Apr 14 17:24:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-b6443e18-ec50-4ec2-926c-666f7e644f99 req-851022c5-4fe7-4a53-b3ba-21c2bb3e4bc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037681 Apr 14 17:24:46 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 281/853] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:24:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:24:46 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-527dfbe4-73f9-4033-a37b-5565034e2188 req-44e98e8f-dab0-4be2-9505-4accc24fd724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66599df0-d961-404f-9573-fe0289019752", "name": "network-vif-plugged", "status": "completed", "tag": "b85a290c-1e7e-4f74-8590-be96f453decf"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:24:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-527dfbe4-73f9-4033-a37b-5565034e2188 req-44e98e8f-dab0-4be2-9505-4accc24fd724 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-527dfbe4-73f9-4033-a37b-5565034e2188 req-44e98e8f-dab0-4be2-9505-4accc24fd724 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-527dfbe4-73f9-4033-a37b-5565034e2188 req-44e98e8f-dab0-4be2-9505-4accc24fd724 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:46 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-527dfbe4-73f9-4033-a37b-5565034e2188 req-44e98e8f-dab0-4be2-9505-4accc24fd724 service nova] Creating event network-vif-plugged:b85a290c-1e7e-4f74-8590-be96f453decf for instance 66599df0-d961-404f-9573-fe0289019752 on user Apr 14 17:24:46 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-527dfbe4-73f9-4033-a37b-5565034e2188 req-44e98e8f-dab0-4be2-9505-4accc24fd724 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033475 Apr 14 17:24:46 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 289/854] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:24:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:24:48 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-010b6ce4-2277-42fc-a8a9-62f8d80ebfb0 req-1692b61f-3d13-4eb4-9b3f-7308d66af48d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66599df0-d961-404f-9573-fe0289019752", "name": "network-vif-plugged", "status": "completed", "tag": "b85a290c-1e7e-4f74-8590-be96f453decf"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:24:48 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:24:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-010b6ce4-2277-42fc-a8a9-62f8d80ebfb0 req-1692b61f-3d13-4eb4-9b3f-7308d66af48d service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-010b6ce4-2277-42fc-a8a9-62f8d80ebfb0 req-1692b61f-3d13-4eb4-9b3f-7308d66af48d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:48 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-010b6ce4-2277-42fc-a8a9-62f8d80ebfb0 req-1692b61f-3d13-4eb4-9b3f-7308d66af48d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:48 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-010b6ce4-2277-42fc-a8a9-62f8d80ebfb0 req-1692b61f-3d13-4eb4-9b3f-7308d66af48d service nova] Creating event network-vif-plugged:b85a290c-1e7e-4f74-8590-be96f453decf for instance 66599df0-d961-404f-9573-fe0289019752 on user Apr 14 17:24:48 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-010b6ce4-2277-42fc-a8a9-62f8d80ebfb0 req-1692b61f-3d13-4eb4-9b3f-7308d66af48d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032046 Apr 14 17:24:48 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 285/855] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:24:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:24:52 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-0424474f-ad39-46e4-82f6-c1ca71b484f1 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:24:52 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-0424474f-ad39-46e4-82f6-c1ca71b484f1 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:24:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0424474f-ad39-46e4-82f6-c1ca71b484f1 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0424474f-ad39-46e4-82f6-c1ca71b484f1 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0424474f-ad39-46e4-82f6-c1ca71b484f1 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0424474f-ad39-46e4-82f6-c1ca71b484f1 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0424474f-ad39-46e4-82f6-c1ca71b484f1 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0424474f-ad39-46e4-82f6-c1ca71b484f1 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:52 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-0424474f-ad39-46e4-82f6-c1ca71b484f1 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092955 Apr 14 17:24:52 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 282/856] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:24:52 2023] GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:24:54 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:24:54 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:24:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:54 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:54 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Going to try to terminate instance {{(pid=61935) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:24:54 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-e70b3857-9341-431f-87ab-8ef2e082468f tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" status: 204 len: 0 microversion: 2.87 time: 0.223900 Apr 14 17:24:54 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 290/857] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 17:24:53 2023] DELETE /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 17:24:54 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a07ef740-5ccc-4949-9108-6f483bee5d67 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:24:54 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-a07ef740-5ccc-4949-9108-6f483bee5d67 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:24:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a07ef740-5ccc-4949-9108-6f483bee5d67 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a07ef740-5ccc-4949-9108-6f483bee5d67 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a07ef740-5ccc-4949-9108-6f483bee5d67 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a07ef740-5ccc-4949-9108-6f483bee5d67 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a07ef740-5ccc-4949-9108-6f483bee5d67 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a07ef740-5ccc-4949-9108-6f483bee5d67 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:54 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-a07ef740-5ccc-4949-9108-6f483bee5d67 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:24:54 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-a07ef740-5ccc-4949-9108-6f483bee5d67 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:24:54 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-a07ef740-5ccc-4949-9108-6f483bee5d67 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:24:54 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-a07ef740-5ccc-4949-9108-6f483bee5d67 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" status: 200 len: 1774 microversion: 2.87 time: 0.314907 Apr 14 17:24:54 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 286/858] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:24:54 2023] GET /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 => generated 1774 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:24:54 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-8abdf80c-ba53-4112-9306-797f03fe672d req-021b1f03-5fbe-418f-b101-18411bf40f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3", "name": "network-vif-unplugged", "status": "completed", "tag": "9262ab81-5611-4d5e-b32b-082b3c4981fd"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:24:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-8abdf80c-ba53-4112-9306-797f03fe672d req-021b1f03-5fbe-418f-b101-18411bf40f77 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-8abdf80c-ba53-4112-9306-797f03fe672d req-021b1f03-5fbe-418f-b101-18411bf40f77 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:54 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-8abdf80c-ba53-4112-9306-797f03fe672d req-021b1f03-5fbe-418f-b101-18411bf40f77 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:54 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-8abdf80c-ba53-4112-9306-797f03fe672d req-021b1f03-5fbe-418f-b101-18411bf40f77 service nova] Creating event network-vif-unplugged:9262ab81-5611-4d5e-b32b-082b3c4981fd for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 on user Apr 14 17:24:54 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-8abdf80c-ba53-4112-9306-797f03fe672d req-021b1f03-5fbe-418f-b101-18411bf40f77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104554 Apr 14 17:24:54 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 283/859] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:24:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:24:56 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-883d6f3b-8dce-4b4d-8a35-5cfc0744ff4b req-02331ae9-aaf3-41b6-8a09-54e92e331baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3", "name": "network-vif-deleted", "tag": "9262ab81-5611-4d5e-b32b-082b3c4981fd"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:24:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-883d6f3b-8dce-4b4d-8a35-5cfc0744ff4b req-02331ae9-aaf3-41b6-8a09-54e92e331baa service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-883d6f3b-8dce-4b4d-8a35-5cfc0744ff4b req-02331ae9-aaf3-41b6-8a09-54e92e331baa service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:56 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-883d6f3b-8dce-4b4d-8a35-5cfc0744ff4b req-02331ae9-aaf3-41b6-8a09-54e92e331baa service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:56 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f873d10-45a0-45c9-97f0-38db11ddc1a1"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:24:56 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:24:56 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-883d6f3b-8dce-4b4d-8a35-5cfc0744ff4b req-02331ae9-aaf3-41b6-8a09-54e92e331baa service nova] Creating event network-vif-deleted:9262ab81-5611-4d5e-b32b-082b3c4981fd for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 on user Apr 14 17:24:56 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-883d6f3b-8dce-4b4d-8a35-5cfc0744ff4b req-02331ae9-aaf3-41b6-8a09-54e92e331baa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032265 Apr 14 17:24:56 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 291/860] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:24:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:24:56 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:56 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:56 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:56 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:56 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:56 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:56 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3", "name": "network-vif-plugged", "status": "completed", "tag": "9262ab81-5611-4d5e-b32b-082b3c4981fd"}, {"server_uuid": "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3", "name": "network-vif-plugged", "status": "completed", "tag": "9262ab81-5611-4d5e-b32b-082b3c4981fd"}, {"server_uuid": "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3", "name": "network-vif-plugged", "status": "completed", "tag": "9262ab81-5611-4d5e-b32b-082b3c4981fd"}, {"server_uuid": "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3", "name": "network-vif-unplugged", "status": "completed", "tag": "9262ab81-5611-4d5e-b32b-082b3c4981fd"}, {"server_uuid": "99e98b6d-e5dd-49b7-b5ec-fba07fed70b3", "name": "network-vif-plugged", "status": "completed", "tag": "9262ab81-5611-4d5e-b32b-082b3c4981fd"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:24:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:24:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:24:56 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:24:56 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Creating event network-vif-plugged:9262ab81-5611-4d5e-b32b-082b3c4981fd for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 on user Apr 14 17:24:56 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Creating event network-vif-plugged:9262ab81-5611-4d5e-b32b-082b3c4981fd for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 on user Apr 14 17:24:56 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Creating event network-vif-plugged:9262ab81-5611-4d5e-b32b-082b3c4981fd for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 on user Apr 14 17:24:56 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Creating event network-vif-unplugged:9262ab81-5611-4d5e-b32b-082b3c4981fd for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 on user Apr 14 17:24:56 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] Creating event network-vif-plugged:9262ab81-5611-4d5e-b32b-082b3c4981fd for instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 on user Apr 14 17:24:56 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-f6e1cce8-9f50-4efb-826e-3dd6b36efa3a req-c440e1ef-a1e4-47b4-8dde-327adc5f6acc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034188 Apr 14 17:24:56 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 284/861] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:24:56 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:24:56 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-3b7b4800-f1b3-4d0b-94d4-724f4ca55e1f tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "POST /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298166 Apr 14 17:24:56 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 287/862] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:24:56 2023] POST /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:25:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-54b6ccbd-6cbb-4483-b22c-97e88c5e4898 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:25:01 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-54b6ccbd-6cbb-4483-b22c-97e88c5e4898 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:25:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-54b6ccbd-6cbb-4483-b22c-97e88c5e4898 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-54b6ccbd-6cbb-4483-b22c-97e88c5e4898 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-54b6ccbd-6cbb-4483-b22c-97e88c5e4898 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-54b6ccbd-6cbb-4483-b22c-97e88c5e4898 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-54b6ccbd-6cbb-4483-b22c-97e88c5e4898 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-54b6ccbd-6cbb-4483-b22c-97e88c5e4898 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:01 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-54b6ccbd-6cbb-4483-b22c-97e88c5e4898 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.237317 Apr 14 17:25:01 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 292/863] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 17:25:00 2023] GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/os-interface => generated 282 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:25:02 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-0d09ca3e-2708-4605-9cd8-a49777ca8cf1 req-50ee47bd-6571-4259-902a-bc97e47c738a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:25:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-0d09ca3e-2708-4605-9cd8-a49777ca8cf1 req-50ee47bd-6571-4259-902a-bc97e47c738a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-0d09ca3e-2708-4605-9cd8-a49777ca8cf1 req-50ee47bd-6571-4259-902a-bc97e47c738a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-0d09ca3e-2708-4605-9cd8-a49777ca8cf1 req-50ee47bd-6571-4259-902a-bc97e47c738a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:02 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-0d09ca3e-2708-4605-9cd8-a49777ca8cf1 req-50ee47bd-6571-4259-902a-bc97e47c738a service nova] Creating event network-changed:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:25:02 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-0d09ca3e-2708-4605-9cd8-a49777ca8cf1 req-50ee47bd-6571-4259-902a-bc97e47c738a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029550 Apr 14 17:25:02 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 285/864] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:25:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:25:02 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:25:02 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:25:02 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=17 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:25:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:02 user devstack@n-api.service[61934]: DEBUG nova.objects.instance [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lazy-loading 'services' on Instance uuid 0cf7a0ce-87a0-4a24-8410-26d056e8816c {{(pid=61934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:25:02 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-117b49e6-7b70-4278-9ef1-364e2d62aaee tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/os-volume_attachments/5380e47e-86ce-482e-b6d7-b756348399d5" status: 202 len: 0 microversion: 2.1 time: 0.202699 Apr 14 17:25:02 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 288/865] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:25:02 2023] DELETE /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/os-volume_attachments/5380e47e-86ce-482e-b6d7-b756348399d5 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:25:02 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-79e19a50-9b40-4b97-b5be-bf4bfe16a153 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:25:02 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-79e19a50-9b40-4b97-b5be-bf4bfe16a153 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:25:02 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:25:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-79e19a50-9b40-4b97-b5be-bf4bfe16a153 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-79e19a50-9b40-4b97-b5be-bf4bfe16a153 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-79e19a50-9b40-4b97-b5be-bf4bfe16a153 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-79e19a50-9b40-4b97-b5be-bf4bfe16a153 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-79e19a50-9b40-4b97-b5be-bf4bfe16a153 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-79e19a50-9b40-4b97-b5be-bf4bfe16a153 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:02 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:25:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-79e19a50-9b40-4b97-b5be-bf4bfe16a153 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088365 Apr 14 17:25:02 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 293/866] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:25:02 2023] GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:25:04 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-b8912aee-069e-4e69-89ce-7a2e2b0b196f req-c06a9b7c-b572-445f-981e-7b77359266a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:25:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-b8912aee-069e-4e69-89ce-7a2e2b0b196f req-c06a9b7c-b572-445f-981e-7b77359266a4 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-b8912aee-069e-4e69-89ce-7a2e2b0b196f req-c06a9b7c-b572-445f-981e-7b77359266a4 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-b8912aee-069e-4e69-89ce-7a2e2b0b196f req-c06a9b7c-b572-445f-981e-7b77359266a4 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:04 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-b8912aee-069e-4e69-89ce-7a2e2b0b196f req-c06a9b7c-b572-445f-981e-7b77359266a4 service nova] Creating event network-changed:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:25:04 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-b8912aee-069e-4e69-89ce-7a2e2b0b196f req-c06a9b7c-b572-445f-981e-7b77359266a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030909 Apr 14 17:25:04 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 286/867] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:25:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:25:07 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:25:07 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:25:07 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:07 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:07 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:07 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:07 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:07 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:07 user devstack@n-api.service[61934]: DEBUG nova.objects.instance [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'services' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=61934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:25:07 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-c7194418-f1f1-4704-abfb-cf3b40788fc2 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments/4f873d10-45a0-45c9-97f0-38db11ddc1a1" status: 202 len: 0 microversion: 2.1 time: 0.176099 Apr 14 17:25:07 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 289/868] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:25:07 2023] DELETE /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments/4f873d10-45a0-45c9-97f0-38db11ddc1a1 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:25:07 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-44c9f4ea-07b1-41db-a576-2d124bfc5ad1 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:25:07 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-44c9f4ea-07b1-41db-a576-2d124bfc5ad1 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:25:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-44c9f4ea-07b1-41db-a576-2d124bfc5ad1 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-44c9f4ea-07b1-41db-a576-2d124bfc5ad1 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-44c9f4ea-07b1-41db-a576-2d124bfc5ad1 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-44c9f4ea-07b1-41db-a576-2d124bfc5ad1 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-44c9f4ea-07b1-41db-a576-2d124bfc5ad1 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:07 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-44c9f4ea-07b1-41db-a576-2d124bfc5ad1 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:07 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-44c9f4ea-07b1-41db-a576-2d124bfc5ad1 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049853 Apr 14 17:25:07 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 294/869] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:25:07 2023] GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:25:13 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-c488b928-d039-4ab7-bf60-1115a0f4310a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:25:13 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-c488b928-d039-4ab7-bf60-1115a0f4310a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:25:13 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:25:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c488b928-d039-4ab7-bf60-1115a0f4310a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c488b928-d039-4ab7-bf60-1115a0f4310a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c488b928-d039-4ab7-bf60-1115a0f4310a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c488b928-d039-4ab7-bf60-1115a0f4310a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c488b928-d039-4ab7-bf60-1115a0f4310a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c488b928-d039-4ab7-bf60-1115a0f4310a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:13 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:25:13 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-c488b928-d039-4ab7-bf60-1115a0f4310a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ea39d187c842788168909de203455e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ab08f97dd54832a7cc975934b1b69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:25:13 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-c488b928-d039-4ab7-bf60-1115a0f4310a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859" status: 200 len: 1537 microversion: 2.1 time: 0.378979 Apr 14 17:25:13 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 287/870] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:25:13 2023] GET /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859 => generated 1537 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:25:15 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-6e69b9f1-36f9-46cb-b183-09b45523a4cf req-4b4ad99b-5dee-4346-bb96-1608a29d46df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1607fec-229c-4bce-b9d4-b8b01a650859", "tag": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:25:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-6e69b9f1-36f9-46cb-b183-09b45523a4cf req-4b4ad99b-5dee-4346-bb96-1608a29d46df service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-6e69b9f1-36f9-46cb-b183-09b45523a4cf req-4b4ad99b-5dee-4346-bb96-1608a29d46df service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-6e69b9f1-36f9-46cb-b183-09b45523a4cf req-4b4ad99b-5dee-4346-bb96-1608a29d46df service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:15 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:25:15 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-6e69b9f1-36f9-46cb-b183-09b45523a4cf req-4b4ad99b-5dee-4346-bb96-1608a29d46df service nova] Creating event network-changed:5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 for instance f1607fec-229c-4bce-b9d4-b8b01a650859 on user Apr 14 17:25:15 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-6e69b9f1-36f9-46cb-b183-09b45523a4cf req-4b4ad99b-5dee-4346-bb96-1608a29d46df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091727 Apr 14 17:25:15 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 290/871] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:25:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:25:15 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abc6b635-bdf6-480f-a80a-de3af477bf40"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:25:15 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:25:15 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:15 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:15 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:15 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:15 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:15 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:15 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-b4caefff-1360-44cb-a20a-d9ba2b0657ff tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273904 Apr 14 17:25:15 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 295/872] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:25:15 2023] POST /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:25:23 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:25:23 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:25:23 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:25:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:23 user devstack@n-api.service[61933]: DEBUG nova.objects.instance [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lazy-loading 'services' on Instance uuid f1607fec-229c-4bce-b9d4-b8b01a650859 {{(pid=61933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:25:23 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-46c8fafe-4bc1-4d16-aa98-b58b68a0536a tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859/os-volume_attachments/abc6b635-bdf6-480f-a80a-de3af477bf40" status: 202 len: 0 microversion: 2.1 time: 0.181132 Apr 14 17:25:23 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 288/873] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:25:23 2023] DELETE /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859/os-volume_attachments/abc6b635-bdf6-480f-a80a-de3af477bf40 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:25:23 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-13dd7c4d-f112-447f-8f67-82fd5ea47a0e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:25:23 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-13dd7c4d-f112-447f-8f67-82fd5ea47a0e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:25:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-13dd7c4d-f112-447f-8f67-82fd5ea47a0e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-13dd7c4d-f112-447f-8f67-82fd5ea47a0e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-13dd7c4d-f112-447f-8f67-82fd5ea47a0e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-13dd7c4d-f112-447f-8f67-82fd5ea47a0e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-13dd7c4d-f112-447f-8f67-82fd5ea47a0e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-13dd7c4d-f112-447f-8f67-82fd5ea47a0e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:23 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-13dd7c4d-f112-447f-8f67-82fd5ea47a0e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047395 Apr 14 17:25:23 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 291/874] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:25:23 2023] GET /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:25:26 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=5 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:25:26 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:25:26 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-3c442357-0175-4a30-9f72-afa81f39ae46 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:25:26 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-3c442357-0175-4a30-9f72-afa81f39ae46 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:25:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3c442357-0175-4a30-9f72-afa81f39ae46 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3c442357-0175-4a30-9f72-afa81f39ae46 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3c442357-0175-4a30-9f72-afa81f39ae46 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3c442357-0175-4a30-9f72-afa81f39ae46 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3c442357-0175-4a30-9f72-afa81f39ae46 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3c442357-0175-4a30-9f72-afa81f39ae46 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:26 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-3c442357-0175-4a30-9f72-afa81f39ae46 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:25:26 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-3c442357-0175-4a30-9f72-afa81f39ae46 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752" status: 200 len: 1427 microversion: 2.1 time: 0.226105 Apr 14 17:25:26 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 296/875] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:25:26 2023] GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752 => generated 1427 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:25:34 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:25:34 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:25:34 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-fdc32f0a-f1c5-47c7-bb7c-805af878cda8 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:25:34 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-fdc32f0a-f1c5-47c7-bb7c-805af878cda8 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] [instance: b9628e25-8292-4b41-87dd-e6149a31f768] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:25:34 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fdc32f0a-f1c5-47c7-bb7c-805af878cda8 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:34 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fdc32f0a-f1c5-47c7-bb7c-805af878cda8 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:34 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fdc32f0a-f1c5-47c7-bb7c-805af878cda8 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:34 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fdc32f0a-f1c5-47c7-bb7c-805af878cda8 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:34 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fdc32f0a-f1c5-47c7-bb7c-805af878cda8 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:34 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-fdc32f0a-f1c5-47c7-bb7c-805af878cda8 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:34 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-fdc32f0a-f1c5-47c7-bb7c-805af878cda8 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] HTTP exception thrown: Instance b9628e25-8292-4b41-87dd-e6149a31f768 could not be found. Apr 14 17:25:34 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-fdc32f0a-f1c5-47c7-bb7c-805af878cda8 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Request method failure captured: Apr 14 17:25:34 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/b9628e25-8292-4b41-87dd-e6149a31f768 HTTP/1.1 Apr 14 17:25:34 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:25:34 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:25:34 user devstack@n-api.service[61933]: Connection: close Apr 14 17:25:34 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:25:34 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:25:34 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:25:34 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:25:34 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:25:34 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYvjafxW3FsODSsJZhGFhHHt4sCbgQ55kEIML61qtvx7W8pGMlxkoF8COjKY5BJa0aULEW4RV9-mVr09hXzEeGBp3Car1yt6oPqr8QRIMd59V0_d2BmZ0D4b4zn7a6mU8ISofHR8JuELJfgx85VcZykRVoSq8CchXMeUYABkuM56zJ4 Apr 14 17:25:34 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:25:34 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:25:34 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:25:34 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:25:34 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:25:34 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:25:34 user devstack@n-api.service[61933]: X-Project-Id: 42aeec65dc86431ba3a607e0c425f130 Apr 14 17:25:34 user devstack@n-api.service[61933]: X-Project-Name: tempest-VolumesActionsTest-241175421 Apr 14 17:25:34 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:25:34 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:25:34 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/42aeec65dc86431ba3a607e0c425f130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/42aeec65dc86431ba3a607e0c425f130"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/42aeec65dc86431ba3a607e0c425f130"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:25:34 user devstack@n-api.service[61933]: X-Tenant: tempest-VolumesActionsTest-241175421 Apr 14 17:25:34 user devstack@n-api.service[61933]: X-Tenant-Id: 42aeec65dc86431ba3a607e0c425f130 Apr 14 17:25:34 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-VolumesActionsTest-241175421 Apr 14 17:25:34 user devstack@n-api.service[61933]: X-User: tempest-VolumesActionsTest-241175421-project-member Apr 14 17:25:34 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:25:34 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:25:34 user devstack@n-api.service[61933]: X-User-Id: 7daa9a32819e442e8c0713f128dbc827 Apr 14 17:25:34 user devstack@n-api.service[61933]: X-User-Name: tempest-VolumesActionsTest-241175421-project-member Apr 14 17:25:34 user devstack@n-api.service[61933]: method: > Apr 14 17:25:34 user devstack@n-api.service[61933]: exception: Instance b9628e25-8292-4b41-87dd-e6149a31f768 could not be found. Apr 14 17:25:34 user devstack@n-api.service[61933]: action_args: {'id': 'b9628e25-8292-4b41-87dd-e6149a31f768'} Apr 14 17:25:34 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9628e25-8292-4b41-87dd-e6149a31f768 could not be found. Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9628e25-8292-4b41-87dd-e6149a31f768 could not be found. Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9628e25-8292-4b41-87dd-e6149a31f768 could not be found. Apr 14 17:25:34 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:25:34 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-fdc32f0a-f1c5-47c7-bb7c-805af878cda8 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] Returning 404 to user: Instance b9628e25-8292-4b41-87dd-e6149a31f768 could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:25:34 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-fdc32f0a-f1c5-47c7-bb7c-805af878cda8 tempest-VolumesActionsTest-241175421 tempest-VolumesActionsTest-241175421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9628e25-8292-4b41-87dd-e6149a31f768" status: 404 len: 111 microversion: 2.1 time: 0.039101 Apr 14 17:25:34 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 289/876] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:25:34 2023] GET /compute/v2.1/servers/b9628e25-8292-4b41-87dd-e6149a31f768 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:25:44 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-e2769b7f-6fcc-4b64-9ac0-ee09f3a90577 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:25:44 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-e2769b7f-6fcc-4b64-9ac0-ee09f3a90577 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:25:44 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=7 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:25:44 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=7 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:25:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e2769b7f-6fcc-4b64-9ac0-ee09f3a90577 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e2769b7f-6fcc-4b64-9ac0-ee09f3a90577 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e2769b7f-6fcc-4b64-9ac0-ee09f3a90577 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e2769b7f-6fcc-4b64-9ac0-ee09f3a90577 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e2769b7f-6fcc-4b64-9ac0-ee09f3a90577 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e2769b7f-6fcc-4b64-9ac0-ee09f3a90577 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:44 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-e2769b7f-6fcc-4b64-9ac0-ee09f3a90577 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] HTTP exception thrown: Instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 could not be found. Apr 14 17:25:44 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-e2769b7f-6fcc-4b64-9ac0-ee09f3a90577 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Request method failure captured: Apr 14 17:25:44 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 HTTP/1.1 Apr 14 17:25:44 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:25:44 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:25:44 user devstack@n-api.service[61934]: Connection: close Apr 14 17:25:44 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:25:44 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:25:44 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:25:44 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:25:44 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:25:44 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYhlBGdiNOo9-YaWATboEfHtn-WySFyJ91dSNs3_y6VgRKA5MuH7pTTMFPZc23dWKc9h9zq4g7g0Wd5Ex-b3mMLpJSBrXd9V9Q22t1x2hbcTm1FdeAFUp0K4xl-5CqDN7BUzXYdKnKPYmeDdU8b-W-6svZe_Q7TzkQpEEMJOoxgNUMI Apr 14 17:25:44 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:25:44 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:25:44 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:25:44 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:25:44 user devstack@n-api.service[61934]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 17:25:44 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:25:44 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:25:44 user devstack@n-api.service[61934]: X-Project-Id: 965bd22f61df40bd89e8ef35fb12bcd3 Apr 14 17:25:44 user devstack@n-api.service[61934]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-995212803 Apr 14 17:25:44 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:25:44 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:25:44 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/965bd22f61df40bd89e8ef35fb12bcd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/965bd22f61df40bd89e8ef35fb12bcd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/965bd22f61df40bd89e8ef35fb12bcd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:25:44 user devstack@n-api.service[61934]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-995212803 Apr 14 17:25:44 user devstack@n-api.service[61934]: X-Tenant-Id: 965bd22f61df40bd89e8ef35fb12bcd3 Apr 14 17:25:44 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-995212803 Apr 14 17:25:44 user devstack@n-api.service[61934]: X-User: tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member Apr 14 17:25:44 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:25:44 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:25:44 user devstack@n-api.service[61934]: X-User-Id: b5c86125160643958349100fb3a7855b Apr 14 17:25:44 user devstack@n-api.service[61934]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member Apr 14 17:25:44 user devstack@n-api.service[61934]: method: > Apr 14 17:25:44 user devstack@n-api.service[61934]: exception: Instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 could not be found. Apr 14 17:25:44 user devstack@n-api.service[61934]: action_args: {'id': '99e98b6d-e5dd-49b7-b5ec-fba07fed70b3'} Apr 14 17:25:44 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 could not be found. Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 could not be found. Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 could not be found. Apr 14 17:25:44 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:25:44 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-e2769b7f-6fcc-4b64-9ac0-ee09f3a90577 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Returning 404 to user: Instance 99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:25:44 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-e2769b7f-6fcc-4b64-9ac0-ee09f3a90577 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3" status: 404 len: 111 microversion: 2.87 time: 0.040751 Apr 14 17:25:44 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 292/877] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:25:44 2023] GET /compute/v2.1/servers/99e98b6d-e5dd-49b7-b5ec-fba07fed70b3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:25:44 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:25:44 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:25:44 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:25:44 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:25:44 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:44 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:44 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:44 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:44 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:44 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:44 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Going to try to terminate instance {{(pid=61935) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:25:44 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-190fa50f-911a-447c-a299-900bc58bc37b tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a3e1f09c-567e-41d1-9c35-58b8371a1d1c" status: 204 len: 0 microversion: 2.87 time: 0.122092 Apr 14 17:25:44 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 297/878] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 17:25:44 2023] DELETE /compute/v2.1/servers/a3e1f09c-567e-41d1-9c35-58b8371a1d1c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 17:25:44 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-2beb2b03-c8df-426f-8dd9-152f7328ae0c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:25:44 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-2beb2b03-c8df-426f-8dd9-152f7328ae0c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:25:44 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:25:44 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:25:44 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2beb2b03-c8df-426f-8dd9-152f7328ae0c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:44 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2beb2b03-c8df-426f-8dd9-152f7328ae0c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:44 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2beb2b03-c8df-426f-8dd9-152f7328ae0c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:44 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2beb2b03-c8df-426f-8dd9-152f7328ae0c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:44 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2beb2b03-c8df-426f-8dd9-152f7328ae0c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:44 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2beb2b03-c8df-426f-8dd9-152f7328ae0c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:45 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-228cf688-1e3c-4fba-83d2-eed0b78e2b5d req-55957149-640b-47d7-950f-8cd2b80f2522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e1f09c-567e-41d1-9c35-58b8371a1d1c", "name": "network-vif-unplugged", "status": "completed", "tag": "26192624-8026-443e-8abd-c2890d04fd77"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:25:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-228cf688-1e3c-4fba-83d2-eed0b78e2b5d req-55957149-640b-47d7-950f-8cd2b80f2522 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-228cf688-1e3c-4fba-83d2-eed0b78e2b5d req-55957149-640b-47d7-950f-8cd2b80f2522 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-228cf688-1e3c-4fba-83d2-eed0b78e2b5d req-55957149-640b-47d7-950f-8cd2b80f2522 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:45 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-228cf688-1e3c-4fba-83d2-eed0b78e2b5d req-55957149-640b-47d7-950f-8cd2b80f2522 service nova] Creating event network-vif-unplugged:26192624-8026-443e-8abd-c2890d04fd77 for instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c on user Apr 14 17:25:45 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-2beb2b03-c8df-426f-8dd9-152f7328ae0c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:25:45 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-228cf688-1e3c-4fba-83d2-eed0b78e2b5d req-55957149-640b-47d7-950f-8cd2b80f2522 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030907 Apr 14 17:25:45 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 293/879] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:25:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:25:45 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-2beb2b03-c8df-426f-8dd9-152f7328ae0c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:25:45 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-2beb2b03-c8df-426f-8dd9-152f7328ae0c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:25:45 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-2beb2b03-c8df-426f-8dd9-152f7328ae0c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3e1f09c-567e-41d1-9c35-58b8371a1d1c" status: 200 len: 1696 microversion: 2.87 time: 0.311889 Apr 14 17:25:45 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 290/880] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:25:44 2023] GET /compute/v2.1/servers/a3e1f09c-567e-41d1-9c35-58b8371a1d1c => generated 1696 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:25:46 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-ba45ff3b-49c8-46bf-b32f-28751b8c6e2d req-abef3e76-da54-4cd6-8ef4-8e8bae311280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e1f09c-567e-41d1-9c35-58b8371a1d1c", "name": "network-vif-deleted", "tag": "26192624-8026-443e-8abd-c2890d04fd77"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:25:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-ba45ff3b-49c8-46bf-b32f-28751b8c6e2d req-abef3e76-da54-4cd6-8ef4-8e8bae311280 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-ba45ff3b-49c8-46bf-b32f-28751b8c6e2d req-abef3e76-da54-4cd6-8ef4-8e8bae311280 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-ba45ff3b-49c8-46bf-b32f-28751b8c6e2d req-abef3e76-da54-4cd6-8ef4-8e8bae311280 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:46 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-ba45ff3b-49c8-46bf-b32f-28751b8c6e2d req-abef3e76-da54-4cd6-8ef4-8e8bae311280 service nova] Creating event network-vif-deleted:26192624-8026-443e-8abd-c2890d04fd77 for instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c on user Apr 14 17:25:46 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-ba45ff3b-49c8-46bf-b32f-28751b8c6e2d req-abef3e76-da54-4cd6-8ef4-8e8bae311280 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035588 Apr 14 17:25:46 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 298/881] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:25:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:25:47 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-58727f9f-b4ef-4815-aa88-5fcf820f80df req-767d6931-0c7c-437f-abb3-f9a1ab5a4559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e1f09c-567e-41d1-9c35-58b8371a1d1c", "name": "network-vif-plugged", "status": "completed", "tag": "26192624-8026-443e-8abd-c2890d04fd77"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:25:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-58727f9f-b4ef-4815-aa88-5fcf820f80df req-767d6931-0c7c-437f-abb3-f9a1ab5a4559 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-58727f9f-b4ef-4815-aa88-5fcf820f80df req-767d6931-0c7c-437f-abb3-f9a1ab5a4559 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-58727f9f-b4ef-4815-aa88-5fcf820f80df req-767d6931-0c7c-437f-abb3-f9a1ab5a4559 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:47 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-58727f9f-b4ef-4815-aa88-5fcf820f80df req-767d6931-0c7c-437f-abb3-f9a1ab5a4559 service nova] Creating event network-vif-plugged:26192624-8026-443e-8abd-c2890d04fd77 for instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c on user Apr 14 17:25:47 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-58727f9f-b4ef-4815-aa88-5fcf820f80df req-767d6931-0c7c-437f-abb3-f9a1ab5a4559 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030358 Apr 14 17:25:47 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 294/882] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:25:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:25:52 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-25afa480-a34c-4d3d-a227-4b878ba58a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:25:52 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-25afa480-a34c-4d3d-a227-4b878ba58a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:25:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-25afa480-a34c-4d3d-a227-4b878ba58a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-25afa480-a34c-4d3d-a227-4b878ba58a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-25afa480-a34c-4d3d-a227-4b878ba58a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-25afa480-a34c-4d3d-a227-4b878ba58a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-25afa480-a34c-4d3d-a227-4b878ba58a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-25afa480-a34c-4d3d-a227-4b878ba58a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:52 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-25afa480-a34c-4d3d-a227-4b878ba58a07 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059453 Apr 14 17:25:52 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 291/883] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:25:52 2023] GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:25:52 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:25:52 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:25:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:52 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Going to try to terminate instance {{(pid=61935) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:25:52 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-5f06a341-dc8d-4ae7-ae99-f5667ac00785 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c" status: 204 len: 0 microversion: 2.1 time: 0.145395 Apr 14 17:25:52 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 299/884] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:25:52 2023] DELETE /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:25:52 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-956220e7-b838-4b24-b7e7-476eca3f0765 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:25:52 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-956220e7-b838-4b24-b7e7-476eca3f0765 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:25:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-956220e7-b838-4b24-b7e7-476eca3f0765 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-956220e7-b838-4b24-b7e7-476eca3f0765 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-956220e7-b838-4b24-b7e7-476eca3f0765 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-956220e7-b838-4b24-b7e7-476eca3f0765 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-956220e7-b838-4b24-b7e7-476eca3f0765 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-956220e7-b838-4b24-b7e7-476eca3f0765 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:53 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-c0608163-4cc2-4508-b973-ef5e6c25b352 req-600b414d-ee0a-48a0-a979-cdb7f41b3421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "name": "network-vif-unplugged", "status": "completed", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:25:53 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c0608163-4cc2-4508-b973-ef5e6c25b352 req-600b414d-ee0a-48a0-a979-cdb7f41b3421 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:53 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c0608163-4cc2-4508-b973-ef5e6c25b352 req-600b414d-ee0a-48a0-a979-cdb7f41b3421 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:53 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c0608163-4cc2-4508-b973-ef5e6c25b352 req-600b414d-ee0a-48a0-a979-cdb7f41b3421 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:53 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-c0608163-4cc2-4508-b973-ef5e6c25b352 req-600b414d-ee0a-48a0-a979-cdb7f41b3421 service nova] Creating event network-vif-unplugged:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:25:53 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-c0608163-4cc2-4508-b973-ef5e6c25b352 req-600b414d-ee0a-48a0-a979-cdb7f41b3421 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036327 Apr 14 17:25:53 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 292/885] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:25:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:25:53 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-956220e7-b838-4b24-b7e7-476eca3f0765 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:25:53 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-956220e7-b838-4b24-b7e7-476eca3f0765 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c" status: 200 len: 1676 microversion: 2.1 time: 0.664805 Apr 14 17:25:53 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 295/886] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:25:52 2023] GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c => generated 1676 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:25:55 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "name": "network-vif-plugged", "status": "completed", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}, {"server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "name": "network-vif-plugged", "status": "completed", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}, {"server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "name": "network-vif-plugged", "status": "completed", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}, {"server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "name": "network-vif-unplugged", "status": "completed", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}, {"server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "name": "network-vif-plugged", "status": "completed", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}, {"server_uuid": "0cf7a0ce-87a0-4a24-8410-26d056e8816c", "name": "network-vif-deleted", "tag": "0880f945-0fa6-4f84-a9ea-71c15e634ac7"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:25:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:55 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Creating event network-vif-plugged:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:25:55 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Creating event network-vif-plugged:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:25:55 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Creating event network-vif-plugged:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:25:55 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Creating event network-vif-unplugged:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:25:55 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Creating event network-vif-plugged:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:25:55 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] Creating event network-vif-deleted:0880f945-0fa6-4f84-a9ea-71c15e634ac7 for instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c on user Apr 14 17:25:55 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-2d0fd3b5-da07-42c8-bb28-2ef7c2ff9e36 req-da25b9ae-5ad8-467a-ae0e-9e5c64ebad32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.037102 Apr 14 17:25:55 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 300/887] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:25:55 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:25:57 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-006fdb0a-5eb0-475a-8cf4-c38bc337b60c tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:25:57 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-006fdb0a-5eb0-475a-8cf4-c38bc337b60c tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:25:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-006fdb0a-5eb0-475a-8cf4-c38bc337b60c tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-006fdb0a-5eb0-475a-8cf4-c38bc337b60c tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-006fdb0a-5eb0-475a-8cf4-c38bc337b60c tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-006fdb0a-5eb0-475a-8cf4-c38bc337b60c tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:25:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-006fdb0a-5eb0-475a-8cf4-c38bc337b60c tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:25:57 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-006fdb0a-5eb0-475a-8cf4-c38bc337b60c tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:25:57 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-006fdb0a-5eb0-475a-8cf4-c38bc337b60c tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.152903 Apr 14 17:25:57 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 293/888] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:25:57 2023] GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments => generated 25 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:26:02 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c977ae16-fe3f-484c-a096-cf1a26e924bf"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:26:02 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:26:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:02 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-b28e0851-a633-4743-a790-ae7e0ddec524 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "POST /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316222 Apr 14 17:26:02 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 296/889] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:26:02 2023] POST /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 17:26:12 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:26:12 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:26:12 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:26:12 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:26:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:12 user devstack@n-api.service[61935]: DEBUG nova.objects.instance [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lazy-loading 'services' on Instance uuid 15ce59e7-b263-4e0b-9f19-638db9606c7b {{(pid=61935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:26:12 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-58b48307-dc00-49cd-9f91-5b8e1c85b5f3 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments/c977ae16-fe3f-484c-a096-cf1a26e924bf" status: 202 len: 0 microversion: 2.1 time: 0.176811 Apr 14 17:26:12 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 301/890] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:26:12 2023] DELETE /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments/c977ae16-fe3f-484c-a096-cf1a26e924bf => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:26:12 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-02ddf6c3-ad12-466e-8269-bcc8d9516244 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:26:12 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-02ddf6c3-ad12-466e-8269-bcc8d9516244 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:26:12 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=10 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:26:12 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=20 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:26:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-02ddf6c3-ad12-466e-8269-bcc8d9516244 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-02ddf6c3-ad12-466e-8269-bcc8d9516244 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-02ddf6c3-ad12-466e-8269-bcc8d9516244 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-02ddf6c3-ad12-466e-8269-bcc8d9516244 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-02ddf6c3-ad12-466e-8269-bcc8d9516244 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:12 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-02ddf6c3-ad12-466e-8269-bcc8d9516244 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:12 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-02ddf6c3-ad12-466e-8269-bcc8d9516244 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059366 Apr 14 17:26:12 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 294/891] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:26:12 2023] GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:26:13 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=10 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:26:13 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:26:13 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-5766d8d7-cc7e-4c8d-8dee-31fa5a5b3991 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:26:13 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-5766d8d7-cc7e-4c8d-8dee-31fa5a5b3991 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:26:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5766d8d7-cc7e-4c8d-8dee-31fa5a5b3991 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5766d8d7-cc7e-4c8d-8dee-31fa5a5b3991 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5766d8d7-cc7e-4c8d-8dee-31fa5a5b3991 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5766d8d7-cc7e-4c8d-8dee-31fa5a5b3991 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5766d8d7-cc7e-4c8d-8dee-31fa5a5b3991 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5766d8d7-cc7e-4c8d-8dee-31fa5a5b3991 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:14 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-5766d8d7-cc7e-4c8d-8dee-31fa5a5b3991 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050019 Apr 14 17:26:14 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 297/892] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:26:13 2023] GET /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:26:14 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:26:14 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:26:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:14 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-d6ba8fb1-0af8-4538-b321-1bbb564b4155 req-8dbbe725-dc45-4c6e-a076-982eea75e178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1607fec-229c-4bce-b9d4-b8b01a650859", "tag": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:26:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-d6ba8fb1-0af8-4538-b321-1bbb564b4155 req-8dbbe725-dc45-4c6e-a076-982eea75e178 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-d6ba8fb1-0af8-4538-b321-1bbb564b4155 req-8dbbe725-dc45-4c6e-a076-982eea75e178 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-d6ba8fb1-0af8-4538-b321-1bbb564b4155 req-8dbbe725-dc45-4c6e-a076-982eea75e178 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:14 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-d6ba8fb1-0af8-4538-b321-1bbb564b4155 req-8dbbe725-dc45-4c6e-a076-982eea75e178 service nova] Creating event network-changed:5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 for instance f1607fec-229c-4bce-b9d4-b8b01a650859 on user Apr 14 17:26:14 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Going to try to terminate instance {{(pid=61935) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:26:14 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-d6ba8fb1-0af8-4538-b321-1bbb564b4155 req-8dbbe725-dc45-4c6e-a076-982eea75e178 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028395 Apr 14 17:26:14 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 295/893] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:26:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:26:15 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-72f42b6f-311a-43cd-96ca-e841436b9884 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859" status: 204 len: 0 microversion: 2.1 time: 0.128242 Apr 14 17:26:15 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 302/894] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:26:14 2023] DELETE /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:26:15 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-889874cc-6b7d-4f3a-8a7a-30fe3743493d tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:26:15 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-889874cc-6b7d-4f3a-8a7a-30fe3743493d tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:26:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-889874cc-6b7d-4f3a-8a7a-30fe3743493d tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-889874cc-6b7d-4f3a-8a7a-30fe3743493d tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-889874cc-6b7d-4f3a-8a7a-30fe3743493d tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-889874cc-6b7d-4f3a-8a7a-30fe3743493d tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-889874cc-6b7d-4f3a-8a7a-30fe3743493d tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-889874cc-6b7d-4f3a-8a7a-30fe3743493d tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:15 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-b9d9319a-168a-4e9a-b0b1-a4db81f86863 req-def0a574-1a39-4cf4-b762-d671189a4385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1607fec-229c-4bce-b9d4-b8b01a650859", "name": "network-vif-unplugged", "status": "completed", "tag": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:26:15 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-b9d9319a-168a-4e9a-b0b1-a4db81f86863 req-def0a574-1a39-4cf4-b762-d671189a4385 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:15 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-b9d9319a-168a-4e9a-b0b1-a4db81f86863 req-def0a574-1a39-4cf4-b762-d671189a4385 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:15 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-b9d9319a-168a-4e9a-b0b1-a4db81f86863 req-def0a574-1a39-4cf4-b762-d671189a4385 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:15 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-b9d9319a-168a-4e9a-b0b1-a4db81f86863 req-def0a574-1a39-4cf4-b762-d671189a4385 service nova] Creating event network-vif-unplugged:5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 for instance f1607fec-229c-4bce-b9d4-b8b01a650859 on user Apr 14 17:26:15 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-b9d9319a-168a-4e9a-b0b1-a4db81f86863 req-def0a574-1a39-4cf4-b762-d671189a4385 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043869 Apr 14 17:26:15 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 296/895] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:26:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:26:15 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-889874cc-6b7d-4f3a-8a7a-30fe3743493d tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ea39d187c842788168909de203455e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ab08f97dd54832a7cc975934b1b69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:26:15 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-889874cc-6b7d-4f3a-8a7a-30fe3743493d tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859" status: 200 len: 1662 microversion: 2.1 time: 0.378013 Apr 14 17:26:15 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 298/896] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:26:15 2023] GET /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859 => generated 1662 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:26:17 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-91418c06-ae07-4a78-a32c-2fb845514ff9 req-154fa8ed-3b0f-4940-8aa8-0980ed9f6172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1607fec-229c-4bce-b9d4-b8b01a650859", "name": "network-vif-deleted", "tag": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:26:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-91418c06-ae07-4a78-a32c-2fb845514ff9 req-154fa8ed-3b0f-4940-8aa8-0980ed9f6172 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-91418c06-ae07-4a78-a32c-2fb845514ff9 req-154fa8ed-3b0f-4940-8aa8-0980ed9f6172 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-91418c06-ae07-4a78-a32c-2fb845514ff9 req-154fa8ed-3b0f-4940-8aa8-0980ed9f6172 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:17 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-91418c06-ae07-4a78-a32c-2fb845514ff9 req-154fa8ed-3b0f-4940-8aa8-0980ed9f6172 service nova] Creating event network-vif-deleted:5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 for instance f1607fec-229c-4bce-b9d4-b8b01a650859 on user Apr 14 17:26:17 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-91418c06-ae07-4a78-a32c-2fb845514ff9 req-154fa8ed-3b0f-4940-8aa8-0980ed9f6172 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030815 Apr 14 17:26:17 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 303/897] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:26:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:26:17 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-ffc7a778-7954-4e7c-9f0d-93158cb41cb6 req-0de7990b-8710-445d-b6ca-e012a13181d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1607fec-229c-4bce-b9d4-b8b01a650859", "name": "network-vif-plugged", "status": "completed", "tag": "5d23bb5b-a645-4a30-9fcf-177b0bfd64f5"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:26:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ffc7a778-7954-4e7c-9f0d-93158cb41cb6 req-0de7990b-8710-445d-b6ca-e012a13181d0 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ffc7a778-7954-4e7c-9f0d-93158cb41cb6 req-0de7990b-8710-445d-b6ca-e012a13181d0 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-ffc7a778-7954-4e7c-9f0d-93158cb41cb6 req-0de7990b-8710-445d-b6ca-e012a13181d0 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:17 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-ffc7a778-7954-4e7c-9f0d-93158cb41cb6 req-0de7990b-8710-445d-b6ca-e012a13181d0 service nova] Creating event network-vif-plugged:5d23bb5b-a645-4a30-9fcf-177b0bfd64f5 for instance f1607fec-229c-4bce-b9d4-b8b01a650859 on user Apr 14 17:26:17 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-ffc7a778-7954-4e7c-9f0d-93158cb41cb6 req-0de7990b-8710-445d-b6ca-e012a13181d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033947 Apr 14 17:26:17 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 297/898] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:26:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:26:27 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-32952b15-496f-42ad-bc36-f5ca01bb26c6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:26:27 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-32952b15-496f-42ad-bc36-f5ca01bb26c6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:26:27 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:26:27 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=12 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:26:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-32952b15-496f-42ad-bc36-f5ca01bb26c6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-32952b15-496f-42ad-bc36-f5ca01bb26c6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-32952b15-496f-42ad-bc36-f5ca01bb26c6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-32952b15-496f-42ad-bc36-f5ca01bb26c6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-32952b15-496f-42ad-bc36-f5ca01bb26c6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-32952b15-496f-42ad-bc36-f5ca01bb26c6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:27 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-32952b15-496f-42ad-bc36-f5ca01bb26c6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.180147 Apr 14 17:26:27 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 299/899] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 17:26:27 2023] GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752/os-interface => generated 282 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:26:27 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:26:27 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:26:27 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-1581170f-de7d-4940-a6b6-31ef451d653b req-ba0bb519-32ca-43cd-87ac-daffb8ea8fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88", "tag": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:26:27 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-1581170f-de7d-4940-a6b6-31ef451d653b req-ba0bb519-32ca-43cd-87ac-daffb8ea8fc8 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:27 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-1581170f-de7d-4940-a6b6-31ef451d653b req-ba0bb519-32ca-43cd-87ac-daffb8ea8fc8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:27 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-1581170f-de7d-4940-a6b6-31ef451d653b req-ba0bb519-32ca-43cd-87ac-daffb8ea8fc8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:27 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=8 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:26:28 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=12 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:26:28 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-a608714d-cde3-4ba0-a088-fa7a78675871 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:26:28 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-1581170f-de7d-4940-a6b6-31ef451d653b req-ba0bb519-32ca-43cd-87ac-daffb8ea8fc8 service nova] Creating event network-changed:ff6f2e44-8051-46b5-9b63-46b5fcc6db6a for instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 on user Apr 14 17:26:28 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-a608714d-cde3-4ba0-a088-fa7a78675871 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:26:28 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-1581170f-de7d-4940-a6b6-31ef451d653b req-ba0bb519-32ca-43cd-87ac-daffb8ea8fc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048972 Apr 14 17:26:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-a608714d-cde3-4ba0-a088-fa7a78675871 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:28 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 304/900] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:26:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:26:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-a608714d-cde3-4ba0-a088-fa7a78675871 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-a608714d-cde3-4ba0-a088-fa7a78675871 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-a608714d-cde3-4ba0-a088-fa7a78675871 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-a608714d-cde3-4ba0-a088-fa7a78675871 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-a608714d-cde3-4ba0-a088-fa7a78675871 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:28 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-a608714d-cde3-4ba0-a088-fa7a78675871 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:26:28 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-a608714d-cde3-4ba0-a088-fa7a78675871 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752" status: 200 len: 1427 microversion: 2.1 time: 0.286228 Apr 14 17:26:28 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 298/901] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:26:27 2023] GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752 => generated 1427 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Old instance type m1.nano, new instance type m1.micro {{(pid=61934) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting quotas for project 978cd1b4b6434b298731b01dac02591c. Resources: {'cores', 'ram'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Getting quotas for user a22398c18fcc48aca2f0f9691f1c1143 and project 978cd1b4b6434b298731b01dac02591c. Resources: {'cores', 'ram'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:26:28 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:26:28 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-74fba4b1-18ee-4ca7-b2bf-fb9601339a06 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "POST /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752/action" status: 202 len: 0 microversion: 2.1 time: 0.190823 Apr 14 17:26:28 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 300/902] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:26:28 2023] POST /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:26:28 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-00e63690-50a2-4eff-9930-c73e70b7d101 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:26:28 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-00e63690-50a2-4eff-9930-c73e70b7d101 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:26:28 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-00e63690-50a2-4eff-9930-c73e70b7d101 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:28 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-00e63690-50a2-4eff-9930-c73e70b7d101 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:28 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-00e63690-50a2-4eff-9930-c73e70b7d101 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:28 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-00e63690-50a2-4eff-9930-c73e70b7d101 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:28 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-00e63690-50a2-4eff-9930-c73e70b7d101 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:28 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-00e63690-50a2-4eff-9930-c73e70b7d101 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:28 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-00e63690-50a2-4eff-9930-c73e70b7d101 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:26:28 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-00e63690-50a2-4eff-9930-c73e70b7d101 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752" status: 200 len: 1436 microversion: 2.1 time: 0.193506 Apr 14 17:26:28 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 305/903] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:26:28 2023] GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752 => generated 1436 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:26:30 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-3de88c6c-5537-4b96-8681-38f8c676147c req-e34e0d79-34ba-4de9-81d7-afb82c3c5faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66599df0-d961-404f-9573-fe0289019752", "tag": "b85a290c-1e7e-4f74-8590-be96f453decf"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:26:30 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-3de88c6c-5537-4b96-8681-38f8c676147c req-e34e0d79-34ba-4de9-81d7-afb82c3c5faf service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:30 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-3de88c6c-5537-4b96-8681-38f8c676147c req-e34e0d79-34ba-4de9-81d7-afb82c3c5faf service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:30 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-3de88c6c-5537-4b96-8681-38f8c676147c req-e34e0d79-34ba-4de9-81d7-afb82c3c5faf service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:30 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-3de88c6c-5537-4b96-8681-38f8c676147c req-e34e0d79-34ba-4de9-81d7-afb82c3c5faf service nova] Creating event network-changed:b85a290c-1e7e-4f74-8590-be96f453decf for instance 66599df0-d961-404f-9573-fe0289019752 on user Apr 14 17:26:30 user devstack@n-api.service[61933]: DEBUG nova.compute.api [req-3de88c6c-5537-4b96-8681-38f8c676147c req-e34e0d79-34ba-4de9-81d7-afb82c3c5faf service nova] Instance 66599df0-d961-404f-9573-fe0289019752 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61933) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 17:26:30 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-3de88c6c-5537-4b96-8681-38f8c676147c req-e34e0d79-34ba-4de9-81d7-afb82c3c5faf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056267 Apr 14 17:26:30 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 299/904] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:26:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:26:32 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66599df0-d961-404f-9573-fe0289019752", "name": "network-vif-unplugged", "status": "completed", "tag": "b85a290c-1e7e-4f74-8590-be96f453decf"}, {"server_uuid": "66599df0-d961-404f-9573-fe0289019752", "name": "network-vif-plugged", "status": "completed", "tag": "b85a290c-1e7e-4f74-8590-be96f453decf"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:26:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:32 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:32 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] Creating event network-vif-unplugged:b85a290c-1e7e-4f74-8590-be96f453decf for instance 66599df0-d961-404f-9573-fe0289019752 on user Apr 14 17:26:32 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] Creating event network-vif-plugged:b85a290c-1e7e-4f74-8590-be96f453decf for instance 66599df0-d961-404f-9573-fe0289019752 on user Apr 14 17:26:32 user devstack@n-api.service[61934]: DEBUG nova.compute.api [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] Instance 66599df0-d961-404f-9573-fe0289019752 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61934) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 17:26:32 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-a65b03ca-478f-450a-8e01-ce66752ea335 req-43baa803-f8cd-4b17-a744-00bef849e165 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.046810 Apr 14 17:26:32 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 301/905] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:26:32 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:26:35 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-0c6e1331-0e27-43b7-bbb1-071ea73b99fd tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:26:35 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-0c6e1331-0e27-43b7-bbb1-071ea73b99fd tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: a3e1f09c-567e-41d1-9c35-58b8371a1d1c] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:26:35 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0c6e1331-0e27-43b7-bbb1-071ea73b99fd tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:35 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0c6e1331-0e27-43b7-bbb1-071ea73b99fd tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:35 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0c6e1331-0e27-43b7-bbb1-071ea73b99fd tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:35 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0c6e1331-0e27-43b7-bbb1-071ea73b99fd tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:35 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0c6e1331-0e27-43b7-bbb1-071ea73b99fd tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:35 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-0c6e1331-0e27-43b7-bbb1-071ea73b99fd tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:35 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-0c6e1331-0e27-43b7-bbb1-071ea73b99fd tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] HTTP exception thrown: Instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c could not be found. Apr 14 17:26:35 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-0c6e1331-0e27-43b7-bbb1-071ea73b99fd tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Request method failure captured: Apr 14 17:26:35 user devstack@n-api.service[61935]: request: GET /compute/v2.1/servers/a3e1f09c-567e-41d1-9c35-58b8371a1d1c HTTP/1.1 Apr 14 17:26:35 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:26:35 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:26:35 user devstack@n-api.service[61935]: Connection: close Apr 14 17:26:35 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:26:35 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:26:35 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:26:35 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:26:35 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:26:35 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYhlBGdiNOo9-YaWATboEfHtn-WySFyJ91dSNs3_y6VgRKA5MuH7pTTMFPZc23dWKc9h9zq4g7g0Wd5Ex-b3mMLpJSBrXd9V9Q22t1x2hbcTm1FdeAFUp0K4xl-5CqDN7BUzXYdKnKPYmeDdU8b-W-6svZe_Q7TzkQpEEMJOoxgNUMI Apr 14 17:26:35 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:26:35 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:26:35 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:26:35 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:26:35 user devstack@n-api.service[61935]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 17:26:35 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:26:35 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:26:35 user devstack@n-api.service[61935]: X-Project-Id: 965bd22f61df40bd89e8ef35fb12bcd3 Apr 14 17:26:35 user devstack@n-api.service[61935]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-995212803 Apr 14 17:26:35 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:26:35 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:26:35 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/965bd22f61df40bd89e8ef35fb12bcd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/965bd22f61df40bd89e8ef35fb12bcd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/965bd22f61df40bd89e8ef35fb12bcd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:26:35 user devstack@n-api.service[61935]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-995212803 Apr 14 17:26:35 user devstack@n-api.service[61935]: X-Tenant-Id: 965bd22f61df40bd89e8ef35fb12bcd3 Apr 14 17:26:35 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-995212803 Apr 14 17:26:35 user devstack@n-api.service[61935]: X-User: tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member Apr 14 17:26:35 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:26:35 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:26:35 user devstack@n-api.service[61935]: X-User-Id: b5c86125160643958349100fb3a7855b Apr 14 17:26:35 user devstack@n-api.service[61935]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member Apr 14 17:26:35 user devstack@n-api.service[61935]: method: > Apr 14 17:26:35 user devstack@n-api.service[61935]: exception: Instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c could not be found. Apr 14 17:26:35 user devstack@n-api.service[61935]: action_args: {'id': 'a3e1f09c-567e-41d1-9c35-58b8371a1d1c'} Apr 14 17:26:35 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c could not be found. Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c could not be found. Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c could not be found. Apr 14 17:26:35 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:26:35 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-0c6e1331-0e27-43b7-bbb1-071ea73b99fd tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Returning 404 to user: Instance a3e1f09c-567e-41d1-9c35-58b8371a1d1c could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:26:35 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-0c6e1331-0e27-43b7-bbb1-071ea73b99fd tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3e1f09c-567e-41d1-9c35-58b8371a1d1c" status: 404 len: 111 microversion: 2.87 time: 0.049920 Apr 14 17:26:35 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 306/906] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:26:35 2023] GET /compute/v2.1/servers/a3e1f09c-567e-41d1-9c35-58b8371a1d1c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:26:35 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:26:35 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:26:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:35 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Going to try to terminate instance {{(pid=61933) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:26:35 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-a439e5a5-2802-49b1-a934-35add41864f7 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b" status: 204 len: 0 microversion: 2.87 time: 0.193713 Apr 14 17:26:35 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 300/907] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 17:26:35 2023] DELETE /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 17:26:35 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-5e743e70-63b3-461d-8207-41edb95c4d1c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:26:35 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-5e743e70-63b3-461d-8207-41edb95c4d1c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:26:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5e743e70-63b3-461d-8207-41edb95c4d1c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5e743e70-63b3-461d-8207-41edb95c4d1c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5e743e70-63b3-461d-8207-41edb95c4d1c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5e743e70-63b3-461d-8207-41edb95c4d1c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5e743e70-63b3-461d-8207-41edb95c4d1c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:35 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-5e743e70-63b3-461d-8207-41edb95c4d1c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:36 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-844d3947-90b0-43b7-be24-a69059e6de92 req-38b9c4d8-34b0-4bc4-a89e-2dcbbd6eb4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1a580c-99da-46df-b02d-e2462d8ef26b", "name": "network-vif-unplugged", "status": "completed", "tag": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:26:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-844d3947-90b0-43b7-be24-a69059e6de92 req-38b9c4d8-34b0-4bc4-a89e-2dcbbd6eb4ab service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-844d3947-90b0-43b7-be24-a69059e6de92 req-38b9c4d8-34b0-4bc4-a89e-2dcbbd6eb4ab service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-844d3947-90b0-43b7-be24-a69059e6de92 req-38b9c4d8-34b0-4bc4-a89e-2dcbbd6eb4ab service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:36 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-844d3947-90b0-43b7-be24-a69059e6de92 req-38b9c4d8-34b0-4bc4-a89e-2dcbbd6eb4ab service nova] Creating event network-vif-unplugged:cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b on user Apr 14 17:26:36 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-844d3947-90b0-43b7-be24-a69059e6de92 req-38b9c4d8-34b0-4bc4-a89e-2dcbbd6eb4ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040548 Apr 14 17:26:36 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 307/908] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:26:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:26:36 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-5e743e70-63b3-461d-8207-41edb95c4d1c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:26:36 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-5e743e70-63b3-461d-8207-41edb95c4d1c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:26:36 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-5e743e70-63b3-461d-8207-41edb95c4d1c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:26:36 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-5e743e70-63b3-461d-8207-41edb95c4d1c tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b" status: 200 len: 1774 microversion: 2.87 time: 0.553825 Apr 14 17:26:36 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 302/909] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:26:35 2023] GET /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b => generated 1774 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:26:37 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-a676c5ae-a918-48f6-bb79-4db79106a882 req-6ea70017-635b-463c-9809-3f2d280daabc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1a580c-99da-46df-b02d-e2462d8ef26b", "name": "network-vif-deleted", "tag": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:26:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-a676c5ae-a918-48f6-bb79-4db79106a882 req-6ea70017-635b-463c-9809-3f2d280daabc service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-a676c5ae-a918-48f6-bb79-4db79106a882 req-6ea70017-635b-463c-9809-3f2d280daabc service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-a676c5ae-a918-48f6-bb79-4db79106a882 req-6ea70017-635b-463c-9809-3f2d280daabc service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:37 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-a676c5ae-a918-48f6-bb79-4db79106a882 req-6ea70017-635b-463c-9809-3f2d280daabc service nova] Creating event network-vif-deleted:cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b on user Apr 14 17:26:37 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-a676c5ae-a918-48f6-bb79-4db79106a882 req-6ea70017-635b-463c-9809-3f2d280daabc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041523 Apr 14 17:26:37 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 301/910] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:26:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:26:38 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-11c39e13-41ef-43f6-8f33-30ede9f84f86 req-19517652-1780-45c0-81d0-dba0c36c5f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1a580c-99da-46df-b02d-e2462d8ef26b", "name": "network-vif-plugged", "status": "completed", "tag": "cc3e7d0d-e167-4a0d-b795-babe496d6f8d"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:26:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-11c39e13-41ef-43f6-8f33-30ede9f84f86 req-19517652-1780-45c0-81d0-dba0c36c5f3a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-11c39e13-41ef-43f6-8f33-30ede9f84f86 req-19517652-1780-45c0-81d0-dba0c36c5f3a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:38 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-11c39e13-41ef-43f6-8f33-30ede9f84f86 req-19517652-1780-45c0-81d0-dba0c36c5f3a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:38 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-11c39e13-41ef-43f6-8f33-30ede9f84f86 req-19517652-1780-45c0-81d0-dba0c36c5f3a service nova] Creating event network-vif-plugged:cc3e7d0d-e167-4a0d-b795-babe496d6f8d for instance 1d1a580c-99da-46df-b02d-e2462d8ef26b on user Apr 14 17:26:38 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-11c39e13-41ef-43f6-8f33-30ede9f84f86 req-19517652-1780-45c0-81d0-dba0c36c5f3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029362 Apr 14 17:26:38 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 308/911] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:26:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:26:42 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-cc88d3df-fd93-4139-9b59-beb343054cc4 req-f964eff1-647d-4375-8333-0b8356bc6cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66599df0-d961-404f-9573-fe0289019752", "name": "network-vif-plugged", "status": "completed", "tag": "b85a290c-1e7e-4f74-8590-be96f453decf"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:26:42 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=3 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:26:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-cc88d3df-fd93-4139-9b59-beb343054cc4 req-f964eff1-647d-4375-8333-0b8356bc6cfd service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-cc88d3df-fd93-4139-9b59-beb343054cc4 req-f964eff1-647d-4375-8333-0b8356bc6cfd service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-cc88d3df-fd93-4139-9b59-beb343054cc4 req-f964eff1-647d-4375-8333-0b8356bc6cfd service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:42 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-cc88d3df-fd93-4139-9b59-beb343054cc4 req-f964eff1-647d-4375-8333-0b8356bc6cfd service nova] Creating event network-vif-plugged:b85a290c-1e7e-4f74-8590-be96f453decf for instance 66599df0-d961-404f-9573-fe0289019752 on user Apr 14 17:26:42 user devstack@n-api.service[61934]: DEBUG nova.compute.api [req-cc88d3df-fd93-4139-9b59-beb343054cc4 req-f964eff1-647d-4375-8333-0b8356bc6cfd service nova] Instance 66599df0-d961-404f-9573-fe0289019752 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61934) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 17:26:42 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-cc88d3df-fd93-4139-9b59-beb343054cc4 req-f964eff1-647d-4375-8333-0b8356bc6cfd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079452 Apr 14 17:26:42 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 303/912] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:26:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:26:43 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-2a22fe9b-06d2-4165-9cc5-185df8e489d5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:26:43 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-2a22fe9b-06d2-4165-9cc5-185df8e489d5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 0cf7a0ce-87a0-4a24-8410-26d056e8816c] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:26:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2a22fe9b-06d2-4165-9cc5-185df8e489d5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2a22fe9b-06d2-4165-9cc5-185df8e489d5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2a22fe9b-06d2-4165-9cc5-185df8e489d5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2a22fe9b-06d2-4165-9cc5-185df8e489d5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2a22fe9b-06d2-4165-9cc5-185df8e489d5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-2a22fe9b-06d2-4165-9cc5-185df8e489d5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:43 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-2a22fe9b-06d2-4165-9cc5-185df8e489d5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] HTTP exception thrown: Instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c could not be found. Apr 14 17:26:43 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-2a22fe9b-06d2-4165-9cc5-185df8e489d5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Request method failure captured: Apr 14 17:26:43 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c HTTP/1.1 Apr 14 17:26:43 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:26:43 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:26:43 user devstack@n-api.service[61933]: Connection: close Apr 14 17:26:43 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:26:43 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:26:43 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:26:43 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:26:43 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:26:43 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYkVBClkxIawkM1nyUWU7TVOYrVEr-N9nAU0PhEuzEE_-YQvgNuTftESHpChD4G1-5d4DpIA7CkgTQ_FGsRsbu8wQIBOC8wC2te9X-DHMsSVpuMD-5ffx2BY9NFTVd25q-U7totKdOrSDVAhHx_Uazr6ZqvpJMFsWKYTM7zuiuFUAR8 Apr 14 17:26:43 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:26:43 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:26:43 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:26:43 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:26:43 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:26:43 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:26:43 user devstack@n-api.service[61933]: X-Project-Id: 070c6b9f620548b183904d1971f35752 Apr 14 17:26:43 user devstack@n-api.service[61933]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2056337871 Apr 14 17:26:43 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:26:43 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:26:43 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/070c6b9f620548b183904d1971f35752"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/070c6b9f620548b183904d1971f35752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/070c6b9f620548b183904d1971f35752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:26:43 user devstack@n-api.service[61933]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2056337871 Apr 14 17:26:43 user devstack@n-api.service[61933]: X-Tenant-Id: 070c6b9f620548b183904d1971f35752 Apr 14 17:26:43 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2056337871 Apr 14 17:26:43 user devstack@n-api.service[61933]: X-User: tempest-ServerRescueNegativeTestJSON-2056337871-project-member Apr 14 17:26:43 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:26:43 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:26:43 user devstack@n-api.service[61933]: X-User-Id: 2434278fe61447fab1f5a930aa16a1de Apr 14 17:26:43 user devstack@n-api.service[61933]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2056337871-project-member Apr 14 17:26:43 user devstack@n-api.service[61933]: method: > Apr 14 17:26:43 user devstack@n-api.service[61933]: exception: Instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c could not be found. Apr 14 17:26:43 user devstack@n-api.service[61933]: action_args: {'id': '0cf7a0ce-87a0-4a24-8410-26d056e8816c'} Apr 14 17:26:43 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c could not be found. Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c could not be found. Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c could not be found. Apr 14 17:26:43 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:26:43 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-2a22fe9b-06d2-4165-9cc5-185df8e489d5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Returning 404 to user: Instance 0cf7a0ce-87a0-4a24-8410-26d056e8816c could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:26:43 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-2a22fe9b-06d2-4165-9cc5-185df8e489d5 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c" status: 404 len: 111 microversion: 2.1 time: 0.036529 Apr 14 17:26:43 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 302/913] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:26:43 2023] GET /compute/v2.1/servers/0cf7a0ce-87a0-4a24-8410-26d056e8816c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:26:43 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-6df76ad9-f0c1-461f-9401-6bb0f60ba14c tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '.version_select at 0x7fe19cc2fe20>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:26:43 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-6df76ad9-f0c1-461f-9401-6bb0f60ba14c tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-167549610" status: 202 len: 0 microversion: 2.1 time: 0.026724 Apr 14 17:26:43 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 309/914] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 17:26:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-167549610 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:26:44 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-e4bfdf4a-bd9a-4692-979c-7965a95f4fb9 req-17267a50-e06d-4244-89df-69526b60c687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66599df0-d961-404f-9573-fe0289019752", "name": "network-vif-plugged", "status": "completed", "tag": "b85a290c-1e7e-4f74-8590-be96f453decf"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:26:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-e4bfdf4a-bd9a-4692-979c-7965a95f4fb9 req-17267a50-e06d-4244-89df-69526b60c687 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-e4bfdf4a-bd9a-4692-979c-7965a95f4fb9 req-17267a50-e06d-4244-89df-69526b60c687 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:44 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-e4bfdf4a-bd9a-4692-979c-7965a95f4fb9 req-17267a50-e06d-4244-89df-69526b60c687 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:44 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-e4bfdf4a-bd9a-4692-979c-7965a95f4fb9 req-17267a50-e06d-4244-89df-69526b60c687 service nova] Creating event network-vif-plugged:b85a290c-1e7e-4f74-8590-be96f453decf for instance 66599df0-d961-404f-9573-fe0289019752 on user Apr 14 17:26:44 user devstack@n-api.service[61934]: DEBUG nova.compute.api [req-e4bfdf4a-bd9a-4692-979c-7965a95f4fb9 req-17267a50-e06d-4244-89df-69526b60c687 service nova] Instance 66599df0-d961-404f-9573-fe0289019752 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61934) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 17:26:44 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-e4bfdf4a-bd9a-4692-979c-7965a95f4fb9 req-17267a50-e06d-4244-89df-69526b60c687 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052581 Apr 14 17:26:44 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 304/915] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:26:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:26:51 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:26:51 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:26:51 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:51 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:51 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:51 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:51 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:51 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:51 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Going to try to terminate instance {{(pid=61933) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:26:51 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-0d6ecc20-bf3d-41b6-99a4-1d6435e88416 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5c01d750-5923-4b61-9f3a-17cf1142f0a5" status: 204 len: 0 microversion: 2.1 time: 0.148088 Apr 14 17:26:51 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 303/916] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:26:51 2023] DELETE /compute/v2.1/servers/5c01d750-5923-4b61-9f3a-17cf1142f0a5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:26:51 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-2ba9624b-035e-4329-8f5e-04976e3f9e01 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:26:51 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-2ba9624b-035e-4329-8f5e-04976e3f9e01 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:26:51 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=14 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:26:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2ba9624b-035e-4329-8f5e-04976e3f9e01 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2ba9624b-035e-4329-8f5e-04976e3f9e01 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2ba9624b-035e-4329-8f5e-04976e3f9e01 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2ba9624b-035e-4329-8f5e-04976e3f9e01 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2ba9624b-035e-4329-8f5e-04976e3f9e01 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:51 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-2ba9624b-035e-4329-8f5e-04976e3f9e01 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:52 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-3724aad3-7cef-4c75-9f2a-f6468a5362fe req-308db138-1490-4423-bed0-062aff68c5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c01d750-5923-4b61-9f3a-17cf1142f0a5", "name": "network-vif-unplugged", "status": "completed", "tag": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:26:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3724aad3-7cef-4c75-9f2a-f6468a5362fe req-308db138-1490-4423-bed0-062aff68c5b3 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3724aad3-7cef-4c75-9f2a-f6468a5362fe req-308db138-1490-4423-bed0-062aff68c5b3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3724aad3-7cef-4c75-9f2a-f6468a5362fe req-308db138-1490-4423-bed0-062aff68c5b3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:52 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-3724aad3-7cef-4c75-9f2a-f6468a5362fe req-308db138-1490-4423-bed0-062aff68c5b3 service nova] Creating event network-vif-unplugged:1d44e719-ffdb-40ff-8b17-bf5d79e1df7e for instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 on user Apr 14 17:26:52 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-3724aad3-7cef-4c75-9f2a-f6468a5362fe req-308db138-1490-4423-bed0-062aff68c5b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038649 Apr 14 17:26:52 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 305/917] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:26:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:26:52 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-2ba9624b-035e-4329-8f5e-04976e3f9e01 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:26:52 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-2ba9624b-035e-4329-8f5e-04976e3f9e01 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c01d750-5923-4b61-9f3a-17cf1142f0a5" status: 200 len: 1495 microversion: 2.1 time: 0.704544 Apr 14 17:26:52 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 310/918] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:26:51 2023] GET /compute/v2.1/servers/5c01d750-5923-4b61-9f3a-17cf1142f0a5 => generated 1495 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:26:53 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-d802e59d-a059-4751-9a40-b6a8ba7253ff req-b1f08f9c-b71e-474b-9a94-c27eff0e46d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c01d750-5923-4b61-9f3a-17cf1142f0a5", "name": "network-vif-deleted", "tag": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:26:53 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-d802e59d-a059-4751-9a40-b6a8ba7253ff req-b1f08f9c-b71e-474b-9a94-c27eff0e46d6 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:53 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-d802e59d-a059-4751-9a40-b6a8ba7253ff req-b1f08f9c-b71e-474b-9a94-c27eff0e46d6 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:53 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-d802e59d-a059-4751-9a40-b6a8ba7253ff req-b1f08f9c-b71e-474b-9a94-c27eff0e46d6 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:53 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-d802e59d-a059-4751-9a40-b6a8ba7253ff req-b1f08f9c-b71e-474b-9a94-c27eff0e46d6 service nova] Creating event network-vif-deleted:1d44e719-ffdb-40ff-8b17-bf5d79e1df7e for instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 on user Apr 14 17:26:53 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-d802e59d-a059-4751-9a40-b6a8ba7253ff req-b1f08f9c-b71e-474b-9a94-c27eff0e46d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053469 Apr 14 17:26:53 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 304/919] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:26:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:26:54 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-b2f16b54-e94e-473b-829e-f9487f28baf1 req-c648cfb8-6e46-4029-a9d6-1f8842e3526f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c01d750-5923-4b61-9f3a-17cf1142f0a5", "name": "network-vif-plugged", "status": "completed", "tag": "1d44e719-ffdb-40ff-8b17-bf5d79e1df7e"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:26:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b2f16b54-e94e-473b-829e-f9487f28baf1 req-c648cfb8-6e46-4029-a9d6-1f8842e3526f service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:26:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b2f16b54-e94e-473b-829e-f9487f28baf1 req-c648cfb8-6e46-4029-a9d6-1f8842e3526f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:26:54 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-b2f16b54-e94e-473b-829e-f9487f28baf1 req-c648cfb8-6e46-4029-a9d6-1f8842e3526f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:26:54 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-b2f16b54-e94e-473b-829e-f9487f28baf1 req-c648cfb8-6e46-4029-a9d6-1f8842e3526f service nova] Creating event network-vif-plugged:1d44e719-ffdb-40ff-8b17-bf5d79e1df7e for instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 on user Apr 14 17:26:54 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-b2f16b54-e94e-473b-829e-f9487f28baf1 req-c648cfb8-6e46-4029-a9d6-1f8842e3526f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045414 Apr 14 17:26:54 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 306/920] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:26:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:27:03 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-fc6bd11a-08f5-4fa2-8b7b-47b089238687 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:27:03 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-fc6bd11a-08f5-4fa2-8b7b-47b089238687 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:27:03 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:03 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-fc6bd11a-08f5-4fa2-8b7b-47b089238687 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-fc6bd11a-08f5-4fa2-8b7b-47b089238687 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-fc6bd11a-08f5-4fa2-8b7b-47b089238687 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-fc6bd11a-08f5-4fa2-8b7b-47b089238687 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-fc6bd11a-08f5-4fa2-8b7b-47b089238687 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:03 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-fc6bd11a-08f5-4fa2-8b7b-47b089238687 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:03 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-fc6bd11a-08f5-4fa2-8b7b-47b089238687 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053084 Apr 14 17:27:03 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 311/921] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 17:27:03 2023] GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 17:27:05 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:05 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:05 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-eed66d53-ca61-4ed9-ac17-f9ee4a8fdd08 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:27:05 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-eed66d53-ca61-4ed9-ac17-f9ee4a8fdd08 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: f1607fec-229c-4bce-b9d4-b8b01a650859] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:27:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-eed66d53-ca61-4ed9-ac17-f9ee4a8fdd08 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-eed66d53-ca61-4ed9-ac17-f9ee4a8fdd08 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-eed66d53-ca61-4ed9-ac17-f9ee4a8fdd08 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-eed66d53-ca61-4ed9-ac17-f9ee4a8fdd08 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-eed66d53-ca61-4ed9-ac17-f9ee4a8fdd08 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-eed66d53-ca61-4ed9-ac17-f9ee4a8fdd08 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:05 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-eed66d53-ca61-4ed9-ac17-f9ee4a8fdd08 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] HTTP exception thrown: Instance f1607fec-229c-4bce-b9d4-b8b01a650859 could not be found. Apr 14 17:27:05 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-eed66d53-ca61-4ed9-ac17-f9ee4a8fdd08 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Request method failure captured: Apr 14 17:27:05 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859 HTTP/1.1 Apr 14 17:27:05 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:27:05 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:27:05 user devstack@n-api.service[61933]: Connection: close Apr 14 17:27:05 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:27:05 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:27:05 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:27:05 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:27:05 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:27:05 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYtDBZl5rWW8RU9q8DH0pUHzGZGV4RliuA1t1AoOFtDV4Pdt3dCUNmRFFwScAZxNT7Ncha8jJRwAtftwRUdUwX-pA-C-HcZt4wv6cgQ6WGNsAVbHP0yC82WUAI8jCL_R-YtY6e6KQtsrR0DyD7_hN1hzIsM6akT9-CD2D5lhsfKmS80 Apr 14 17:27:05 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:27:05 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:27:05 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:27:05 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:27:05 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:27:05 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:27:05 user devstack@n-api.service[61933]: X-Project-Id: f7ab08f97dd54832a7cc975934b1b69f Apr 14 17:27:05 user devstack@n-api.service[61933]: X-Project-Name: tempest-TestStampPattern-872060463 Apr 14 17:27:05 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:27:05 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:27:05 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7ab08f97dd54832a7cc975934b1b69f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7ab08f97dd54832a7cc975934b1b69f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f7ab08f97dd54832a7cc975934b1b69f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:27:05 user devstack@n-api.service[61933]: X-Tenant: tempest-TestStampPattern-872060463 Apr 14 17:27:05 user devstack@n-api.service[61933]: X-Tenant-Id: f7ab08f97dd54832a7cc975934b1b69f Apr 14 17:27:05 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-TestStampPattern-872060463 Apr 14 17:27:05 user devstack@n-api.service[61933]: X-User: tempest-TestStampPattern-872060463-project-member Apr 14 17:27:05 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:27:05 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:27:05 user devstack@n-api.service[61933]: X-User-Id: b8ea39d187c842788168909de203455e Apr 14 17:27:05 user devstack@n-api.service[61933]: X-User-Name: tempest-TestStampPattern-872060463-project-member Apr 14 17:27:05 user devstack@n-api.service[61933]: method: > Apr 14 17:27:05 user devstack@n-api.service[61933]: exception: Instance f1607fec-229c-4bce-b9d4-b8b01a650859 could not be found. Apr 14 17:27:05 user devstack@n-api.service[61933]: action_args: {'id': 'f1607fec-229c-4bce-b9d4-b8b01a650859'} Apr 14 17:27:05 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1607fec-229c-4bce-b9d4-b8b01a650859 could not be found. Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1607fec-229c-4bce-b9d4-b8b01a650859 could not be found. Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1607fec-229c-4bce-b9d4-b8b01a650859 could not be found. Apr 14 17:27:05 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:27:05 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-eed66d53-ca61-4ed9-ac17-f9ee4a8fdd08 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Returning 404 to user: Instance f1607fec-229c-4bce-b9d4-b8b01a650859 could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:27:05 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-eed66d53-ca61-4ed9-ac17-f9ee4a8fdd08 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859" status: 404 len: 111 microversion: 2.1 time: 0.041405 Apr 14 17:27:05 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 305/922] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:27:05 2023] GET /compute/v2.1/servers/f1607fec-229c-4bce-b9d4-b8b01a650859 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:27:12 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=30 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:12 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:12 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-939dc0a1-655a-4c95-9d71-42e58661287e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:27:12 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-939dc0a1-655a-4c95-9d71-42e58661287e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:27:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-939dc0a1-655a-4c95-9d71-42e58661287e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-939dc0a1-655a-4c95-9d71-42e58661287e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-939dc0a1-655a-4c95-9d71-42e58661287e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-939dc0a1-655a-4c95-9d71-42e58661287e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-939dc0a1-655a-4c95-9d71-42e58661287e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-939dc0a1-655a-4c95-9d71-42e58661287e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:12 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-939dc0a1-655a-4c95-9d71-42e58661287e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] HTTP exception thrown: Instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 is not attached to volume 7a4503ad-f051-411d-a9c8-b5900017cda6 Apr 14 17:27:12 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-939dc0a1-655a-4c95-9d71-42e58661287e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Request method failure captured: Apr 14 17:27:12 user devstack@n-api.service[61934]: request: DELETE /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682/os-volume_attachments/7a4503ad-f051-411d-a9c8-b5900017cda6 HTTP/1.1 Apr 14 17:27:12 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:27:12 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:27:12 user devstack@n-api.service[61934]: Connection: close Apr 14 17:27:12 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:27:12 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:27:12 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:27:12 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:27:12 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:27:12 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYtDBZl5rWW8RU9q8DH0pUHzGZGV4RliuA1t1AoOFtDV4Pdt3dCUNmRFFwScAZxNT7Ncha8jJRwAtftwRUdUwX-pA-C-HcZt4wv6cgQ6WGNsAVbHP0yC82WUAI8jCL_R-YtY6e6KQtsrR0DyD7_hN1hzIsM6akT9-CD2D5lhsfKmS80 Apr 14 17:27:12 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:27:12 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:27:12 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:27:12 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:27:12 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:27:12 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:27:12 user devstack@n-api.service[61934]: X-Project-Id: f7ab08f97dd54832a7cc975934b1b69f Apr 14 17:27:12 user devstack@n-api.service[61934]: X-Project-Name: tempest-TestStampPattern-872060463 Apr 14 17:27:12 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:27:12 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:27:12 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7ab08f97dd54832a7cc975934b1b69f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7ab08f97dd54832a7cc975934b1b69f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f7ab08f97dd54832a7cc975934b1b69f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:27:12 user devstack@n-api.service[61934]: X-Tenant: tempest-TestStampPattern-872060463 Apr 14 17:27:12 user devstack@n-api.service[61934]: X-Tenant-Id: f7ab08f97dd54832a7cc975934b1b69f Apr 14 17:27:12 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-TestStampPattern-872060463 Apr 14 17:27:12 user devstack@n-api.service[61934]: X-User: tempest-TestStampPattern-872060463-project-member Apr 14 17:27:12 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:27:12 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:27:12 user devstack@n-api.service[61934]: X-User-Id: b8ea39d187c842788168909de203455e Apr 14 17:27:12 user devstack@n-api.service[61934]: X-User-Name: tempest-TestStampPattern-872060463-project-member Apr 14 17:27:12 user devstack@n-api.service[61934]: method: > Apr 14 17:27:12 user devstack@n-api.service[61934]: exception: Instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 is not attached to volume 7a4503ad-f051-411d-a9c8-b5900017cda6 Apr 14 17:27:12 user devstack@n-api.service[61934]: action_args: {'server_id': '15a48598-5e5d-450b-a6c5-d7637a6d8682', 'id': '7a4503ad-f051-411d-a9c8-b5900017cda6'} Apr 14 17:27:12 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7a4503ad-f051-411d-a9c8-b5900017cda6. Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 is not attached to volume 7a4503ad-f051-411d-a9c8-b5900017cda6 Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 is not attached to volume 7a4503ad-f051-411d-a9c8-b5900017cda6 Apr 14 17:27:12 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:27:12 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-939dc0a1-655a-4c95-9d71-42e58661287e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Returning 404 to user: Instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 is not attached to volume 7a4503ad-f051-411d-a9c8-b5900017cda6 {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:27:12 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-939dc0a1-655a-4c95-9d71-42e58661287e tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682/os-volume_attachments/7a4503ad-f051-411d-a9c8-b5900017cda6" status: 404 len: 154 microversion: 2.1 time: 0.171275 Apr 14 17:27:12 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 307/923] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:27:12 2023] DELETE /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682/os-volume_attachments/7a4503ad-f051-411d-a9c8-b5900017cda6 => generated 154 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:27:13 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:13 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:13 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:27:13 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:27:13 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-0e23a7af-b6a3-46a3-8771-ea677e31140a req-78777b16-b821-4928-ba7a-410ef511c362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a48598-5e5d-450b-a6c5-d7637a6d8682", "tag": "4e3c902c-c5f1-4842-8338-fc701ab2e11a"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:27:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-0e23a7af-b6a3-46a3-8771-ea677e31140a req-78777b16-b821-4928-ba7a-410ef511c362 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-0e23a7af-b6a3-46a3-8771-ea677e31140a req-78777b16-b821-4928-ba7a-410ef511c362 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-0e23a7af-b6a3-46a3-8771-ea677e31140a req-78777b16-b821-4928-ba7a-410ef511c362 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:13 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-0e23a7af-b6a3-46a3-8771-ea677e31140a req-78777b16-b821-4928-ba7a-410ef511c362 service nova] Creating event network-changed:4e3c902c-c5f1-4842-8338-fc701ab2e11a for instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 on user Apr 14 17:27:13 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-0e23a7af-b6a3-46a3-8771-ea677e31140a req-78777b16-b821-4928-ba7a-410ef511c362 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032331 Apr 14 17:27:13 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 306/924] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:27:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 17:27:13 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Going to try to terminate instance {{(pid=61935) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:27:13 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-7f17208a-7727-4c31-90d9-54a0e89cde72 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682" status: 204 len: 0 microversion: 2.1 time: 0.391697 Apr 14 17:27:13 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 312/925] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:27:13 2023] DELETE /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:27:13 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-55917357-33e4-4849-b872-17acf54eed83 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:27:13 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-55917357-33e4-4849-b872-17acf54eed83 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:27:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-55917357-33e4-4849-b872-17acf54eed83 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-55917357-33e4-4849-b872-17acf54eed83 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-55917357-33e4-4849-b872-17acf54eed83 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-55917357-33e4-4849-b872-17acf54eed83 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-55917357-33e4-4849-b872-17acf54eed83 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-55917357-33e4-4849-b872-17acf54eed83 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:13 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-55917357-33e4-4849-b872-17acf54eed83 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ea39d187c842788168909de203455e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ab08f97dd54832a7cc975934b1b69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:27:13 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-55917357-33e4-4849-b872-17acf54eed83 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682" status: 200 len: 1663 microversion: 2.1 time: 0.323386 Apr 14 17:27:13 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 308/926] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:27:13 2023] GET /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682 => generated 1663 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:27:13 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-57d07d0a-f824-4bd9-b0d9-2d17bb115bf1 req-499f1e6f-5462-432d-9f47-a8bc5b1cb9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a48598-5e5d-450b-a6c5-d7637a6d8682", "name": "network-vif-unplugged", "status": "completed", "tag": "4e3c902c-c5f1-4842-8338-fc701ab2e11a"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:27:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-57d07d0a-f824-4bd9-b0d9-2d17bb115bf1 req-499f1e6f-5462-432d-9f47-a8bc5b1cb9d9 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-57d07d0a-f824-4bd9-b0d9-2d17bb115bf1 req-499f1e6f-5462-432d-9f47-a8bc5b1cb9d9 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-57d07d0a-f824-4bd9-b0d9-2d17bb115bf1 req-499f1e6f-5462-432d-9f47-a8bc5b1cb9d9 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:14 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-57d07d0a-f824-4bd9-b0d9-2d17bb115bf1 req-499f1e6f-5462-432d-9f47-a8bc5b1cb9d9 service nova] Creating event network-vif-unplugged:4e3c902c-c5f1-4842-8338-fc701ab2e11a for instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 on user Apr 14 17:27:14 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-57d07d0a-f824-4bd9-b0d9-2d17bb115bf1 req-499f1e6f-5462-432d-9f47-a8bc5b1cb9d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051001 Apr 14 17:27:14 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 307/927] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:27:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:27:15 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-195f3b68-8b60-4950-980b-07234818ca91 req-4d4aaabd-bc3e-4866-b3b0-b46e864fb05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a48598-5e5d-450b-a6c5-d7637a6d8682", "name": "network-vif-deleted", "tag": "4e3c902c-c5f1-4842-8338-fc701ab2e11a"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:27:15 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-195f3b68-8b60-4950-980b-07234818ca91 req-4d4aaabd-bc3e-4866-b3b0-b46e864fb05c service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:15 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-195f3b68-8b60-4950-980b-07234818ca91 req-4d4aaabd-bc3e-4866-b3b0-b46e864fb05c service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:15 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-195f3b68-8b60-4950-980b-07234818ca91 req-4d4aaabd-bc3e-4866-b3b0-b46e864fb05c service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:15 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-195f3b68-8b60-4950-980b-07234818ca91 req-4d4aaabd-bc3e-4866-b3b0-b46e864fb05c service nova] Creating event network-vif-deleted:4e3c902c-c5f1-4842-8338-fc701ab2e11a for instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 on user Apr 14 17:27:15 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-195f3b68-8b60-4950-980b-07234818ca91 req-4d4aaabd-bc3e-4866-b3b0-b46e864fb05c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029863 Apr 14 17:27:15 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 313/928] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:27:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:27:16 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-ae54326b-2186-421c-8488-089b037b0389 req-0b0e0c14-d0eb-49a9-819e-4356fb8edb04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a48598-5e5d-450b-a6c5-d7637a6d8682", "name": "network-vif-plugged", "status": "completed", "tag": "4e3c902c-c5f1-4842-8338-fc701ab2e11a"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:27:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ae54326b-2186-421c-8488-089b037b0389 req-0b0e0c14-d0eb-49a9-819e-4356fb8edb04 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ae54326b-2186-421c-8488-089b037b0389 req-0b0e0c14-d0eb-49a9-819e-4356fb8edb04 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ae54326b-2186-421c-8488-089b037b0389 req-0b0e0c14-d0eb-49a9-819e-4356fb8edb04 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:16 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-ae54326b-2186-421c-8488-089b037b0389 req-0b0e0c14-d0eb-49a9-819e-4356fb8edb04 service nova] Creating event network-vif-plugged:4e3c902c-c5f1-4842-8338-fc701ab2e11a for instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 on user Apr 14 17:27:16 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-ae54326b-2186-421c-8488-089b037b0389 req-0b0e0c14-d0eb-49a9-819e-4356fb8edb04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028842 Apr 14 17:27:16 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 309/929] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:27:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:27:18 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-411aad8f-f862-42c1-9f80-5c8d4d44f12c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:27:18 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-411aad8f-f862-42c1-9f80-5c8d4d44f12c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:27:18 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-411aad8f-f862-42c1-9f80-5c8d4d44f12c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:18 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-411aad8f-f862-42c1-9f80-5c8d4d44f12c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:18 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-411aad8f-f862-42c1-9f80-5c8d4d44f12c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:18 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-411aad8f-f862-42c1-9f80-5c8d4d44f12c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:18 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-411aad8f-f862-42c1-9f80-5c8d4d44f12c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:18 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-411aad8f-f862-42c1-9f80-5c8d4d44f12c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:19 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-411aad8f-f862-42c1-9f80-5c8d4d44f12c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:27:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-411aad8f-f862-42c1-9f80-5c8d4d44f12c tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752" status: 200 len: 1554 microversion: 2.1 time: 0.355993 Apr 14 17:27:19 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 308/930] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:27:18 2023] GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752 => generated 1554 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:27:25 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:25 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:25 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-87879708", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:27:25 user devstack@n-api.service[61935]: DEBUG nova.network.neutron [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] validate_networks() for None {{(pid=61935) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Flavor limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Image limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Flavor pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Image pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Getting quotas for project a442e486d0ac4ac8ad8205e16f9df504. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Getting quotas for user 6e9c6562cb6341e1b4eeebbe95fcb981 and project a442e486d0ac4ac8ad8205e16f9df504. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Going to run 1 instances... {{(pid=61935) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:27:26 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-4089641e-0d09-4ece-bcff-32e0cc50522b tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.865804 Apr 14 17:27:26 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 314/931] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:27:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:27:26 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:26 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=14 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:26 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-cf515d51-7fb9-4ae3-b1a7-d350a938a143 tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:27:26 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-cf515d51-7fb9-4ae3-b1a7-d350a938a143 tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-123b2367-4bf6-4158-89be-365a2b09db71 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-123b2367-4bf6-4158-89be-365a2b09db71 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 1d1a580c-99da-46df-b02d-e2462d8ef26b] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-123b2367-4bf6-4158-89be-365a2b09db71 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-123b2367-4bf6-4158-89be-365a2b09db71 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-123b2367-4bf6-4158-89be-365a2b09db71 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-123b2367-4bf6-4158-89be-365a2b09db71 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-123b2367-4bf6-4158-89be-365a2b09db71 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-123b2367-4bf6-4158-89be-365a2b09db71 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:26 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-123b2367-4bf6-4158-89be-365a2b09db71 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] HTTP exception thrown: Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b could not be found. Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-123b2367-4bf6-4158-89be-365a2b09db71 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Request method failure captured: Apr 14 17:27:26 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b HTTP/1.1 Apr 14 17:27:26 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:27:26 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:27:26 user devstack@n-api.service[61933]: Connection: close Apr 14 17:27:26 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:27:26 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:27:26 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:27:26 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:27:26 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:27:26 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYhlBGdiNOo9-YaWATboEfHtn-WySFyJ91dSNs3_y6VgRKA5MuH7pTTMFPZc23dWKc9h9zq4g7g0Wd5Ex-b3mMLpJSBrXd9V9Q22t1x2hbcTm1FdeAFUp0K4xl-5CqDN7BUzXYdKnKPYmeDdU8b-W-6svZe_Q7TzkQpEEMJOoxgNUMI Apr 14 17:27:26 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:27:26 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:27:26 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:27:26 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:27:26 user devstack@n-api.service[61933]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 17:27:26 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:27:26 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:27:26 user devstack@n-api.service[61933]: X-Project-Id: 965bd22f61df40bd89e8ef35fb12bcd3 Apr 14 17:27:26 user devstack@n-api.service[61933]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-995212803 Apr 14 17:27:26 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:27:26 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:27:26 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/965bd22f61df40bd89e8ef35fb12bcd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/965bd22f61df40bd89e8ef35fb12bcd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/965bd22f61df40bd89e8ef35fb12bcd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:27:26 user devstack@n-api.service[61933]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-995212803 Apr 14 17:27:26 user devstack@n-api.service[61933]: X-Tenant-Id: 965bd22f61df40bd89e8ef35fb12bcd3 Apr 14 17:27:26 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-995212803 Apr 14 17:27:26 user devstack@n-api.service[61933]: X-User: tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member Apr 14 17:27:26 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:27:26 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:27:26 user devstack@n-api.service[61933]: X-User-Id: b5c86125160643958349100fb3a7855b Apr 14 17:27:26 user devstack@n-api.service[61933]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member Apr 14 17:27:26 user devstack@n-api.service[61933]: method: > Apr 14 17:27:26 user devstack@n-api.service[61933]: exception: Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b could not be found. Apr 14 17:27:26 user devstack@n-api.service[61933]: action_args: {'id': '1d1a580c-99da-46df-b02d-e2462d8ef26b'} Apr 14 17:27:26 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b could not be found. Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b could not be found. Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b could not be found. Apr 14 17:27:26 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-123b2367-4bf6-4158-89be-365a2b09db71 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Returning 404 to user: Instance 1d1a580c-99da-46df-b02d-e2462d8ef26b could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:27:26 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-123b2367-4bf6-4158-89be-365a2b09db71 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b" status: 404 len: 111 microversion: 2.87 time: 0.028864 Apr 14 17:27:26 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 309/932] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:27:26 2023] GET /compute/v2.1/servers/1d1a580c-99da-46df-b02d-e2462d8ef26b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:27:26 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-cf515d51-7fb9-4ae3-b1a7-d350a938a143 tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9c6562cb6341e1b4eeebbe95fcb981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a442e486d0ac4ac8ad8205e16f9df504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:27:26 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-cf515d51-7fb9-4ae3-b1a7-d350a938a143 tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34b83ea6-ac75-48ad-b452-0e74151e1e1c" status: 200 len: 1207 microversion: 2.1 time: 0.101156 Apr 14 17:27:26 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 310/933] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:27:26 2023] GET /compute/v2.1/servers/34b83ea6-ac75-48ad-b452-0e74151e1e1c => generated 1207 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-6c175e28-d7cd-471c-9f31-e90b14b476ae req-5bffdbcc-6ccf-46ea-af56-7556ea70d157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ce59e7-b263-4e0b-9f19-638db9606c7b", "tag": "7549a60b-8755-4baa-bf6b-6571c0cbb88b"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-6c175e28-d7cd-471c-9f31-e90b14b476ae req-5bffdbcc-6ccf-46ea-af56-7556ea70d157 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-6c175e28-d7cd-471c-9f31-e90b14b476ae req-5bffdbcc-6ccf-46ea-af56-7556ea70d157 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:26 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-6c175e28-d7cd-471c-9f31-e90b14b476ae req-5bffdbcc-6ccf-46ea-af56-7556ea70d157 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:26 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-6c175e28-d7cd-471c-9f31-e90b14b476ae req-5bffdbcc-6ccf-46ea-af56-7556ea70d157 service nova] Creating event network-changed:7549a60b-8755-4baa-bf6b-6571c0cbb88b for instance 15ce59e7-b263-4e0b-9f19-638db9606c7b on user Apr 14 17:27:26 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-6c175e28-d7cd-471c-9f31-e90b14b476ae req-5bffdbcc-6ccf-46ea-af56-7556ea70d157 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028421 Apr 14 17:27:26 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 315/934] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:27:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:26 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Going to try to terminate instance {{(pid=61933) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:27:26 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-0aab578b-acef-4b70-b7ce-41004ab84e1a tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" status: 204 len: 0 microversion: 2.87 time: 0.127061 Apr 14 17:27:26 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 310/935] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 17:27:26 2023] DELETE /compute/v2.1/servers/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 17:27:26 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-6f9c57d1-80b6-4b23-92de-1952a2a91eed tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:27:26 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-6f9c57d1-80b6-4b23-92de-1952a2a91eed tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:27:26 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6f9c57d1-80b6-4b23-92de-1952a2a91eed tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:26 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6f9c57d1-80b6-4b23-92de-1952a2a91eed tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:26 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6f9c57d1-80b6-4b23-92de-1952a2a91eed tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:26 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6f9c57d1-80b6-4b23-92de-1952a2a91eed tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:26 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6f9c57d1-80b6-4b23-92de-1952a2a91eed tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:26 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6f9c57d1-80b6-4b23-92de-1952a2a91eed tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:26 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-6f9c57d1-80b6-4b23-92de-1952a2a91eed tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:27:26 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-6f9c57d1-80b6-4b23-92de-1952a2a91eed tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:27:26 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-6f9c57d1-80b6-4b23-92de-1952a2a91eed tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c86125160643958349100fb3a7855b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965bd22f61df40bd89e8ef35fb12bcd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:27:26 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-6f9c57d1-80b6-4b23-92de-1952a2a91eed tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" status: 200 len: 1696 microversion: 2.87 time: 0.387309 Apr 14 17:27:26 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 311/936] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:27:26 2023] GET /compute/v2.1/servers/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f => generated 1696 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 17:27:27 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-6a6d65c7-07c7-4bad-a67a-0ca8932f4d1a req-b32d7070-8fa1-42e9-aef3-d85706bf3836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f", "name": "network-vif-deleted", "tag": "4ca35158-a3a3-41be-bfea-28f8bf46a796"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:27:27 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-6a6d65c7-07c7-4bad-a67a-0ca8932f4d1a req-b32d7070-8fa1-42e9-aef3-d85706bf3836 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:27 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-6a6d65c7-07c7-4bad-a67a-0ca8932f4d1a req-b32d7070-8fa1-42e9-aef3-d85706bf3836 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:27 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-6a6d65c7-07c7-4bad-a67a-0ca8932f4d1a req-b32d7070-8fa1-42e9-aef3-d85706bf3836 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:27 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-6a6d65c7-07c7-4bad-a67a-0ca8932f4d1a req-b32d7070-8fa1-42e9-aef3-d85706bf3836 service nova] Creating event network-vif-deleted:4ca35158-a3a3-41be-bfea-28f8bf46a796 for instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f on user Apr 14 17:27:27 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-6a6d65c7-07c7-4bad-a67a-0ca8932f4d1a req-b32d7070-8fa1-42e9-aef3-d85706bf3836 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048126 Apr 14 17:27:27 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 316/937] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:27:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:27:28 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f", "name": "network-vif-unplugged", "status": "completed", "tag": "4ca35158-a3a3-41be-bfea-28f8bf46a796"}, {"server_uuid": "4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f", "name": "network-vif-plugged", "status": "completed", "tag": "4ca35158-a3a3-41be-bfea-28f8bf46a796"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:27:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:28 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:28 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] Creating event network-vif-unplugged:4ca35158-a3a3-41be-bfea-28f8bf46a796 for instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f on user Apr 14 17:27:28 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] Creating event network-vif-plugged:4ca35158-a3a3-41be-bfea-28f8bf46a796 for instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f on user Apr 14 17:27:28 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-c0fc8888-06f1-411d-935b-9625f28220e6 req-570dadb0-d922-4527-ad64-f139d74ba224 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031888 Apr 14 17:27:28 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 311/938] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:27:28 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:27:28 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-797d2b9e-cbc1-4d6a-b92a-4a12b6995fb6 req-f2888ed5-f1a6-4fc0-9041-866ddf21d35f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34b83ea6-ac75-48ad-b452-0e74151e1e1c", "tag": "1073478a-c9c5-4548-8276-ba9edb79833e"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:27:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-797d2b9e-cbc1-4d6a-b92a-4a12b6995fb6 req-f2888ed5-f1a6-4fc0-9041-866ddf21d35f service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-797d2b9e-cbc1-4d6a-b92a-4a12b6995fb6 req-f2888ed5-f1a6-4fc0-9041-866ddf21d35f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:28 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-797d2b9e-cbc1-4d6a-b92a-4a12b6995fb6 req-f2888ed5-f1a6-4fc0-9041-866ddf21d35f service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:28 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-797d2b9e-cbc1-4d6a-b92a-4a12b6995fb6 req-f2888ed5-f1a6-4fc0-9041-866ddf21d35f service nova] Creating event network-changed:1073478a-c9c5-4548-8276-ba9edb79833e for instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c on user Apr 14 17:27:28 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-797d2b9e-cbc1-4d6a-b92a-4a12b6995fb6 req-f2888ed5-f1a6-4fc0-9041-866ddf21d35f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034802 Apr 14 17:27:28 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 312/939] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:27:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:27:29 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:27:29 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:27:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:29 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Going to try to terminate instance {{(pid=61935) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:27:29 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-269ea519-a82f-4d97-afda-e40b6215356e tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b" status: 204 len: 0 microversion: 2.1 time: 0.134412 Apr 14 17:27:29 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 317/940] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:27:29 2023] DELETE /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:27:29 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-c75c6d30-8044-4117-964b-e93bd9b34273 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:27:29 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-c75c6d30-8044-4117-964b-e93bd9b34273 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:27:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c75c6d30-8044-4117-964b-e93bd9b34273 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c75c6d30-8044-4117-964b-e93bd9b34273 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c75c6d30-8044-4117-964b-e93bd9b34273 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c75c6d30-8044-4117-964b-e93bd9b34273 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c75c6d30-8044-4117-964b-e93bd9b34273 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c75c6d30-8044-4117-964b-e93bd9b34273 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:30 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-c75c6d30-8044-4117-964b-e93bd9b34273 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecae496b720c4e09b90986969d9ae9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3e0c3b9c7b4ca79b75def0f04f5549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:27:30 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-c75c6d30-8044-4117-964b-e93bd9b34273 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b" status: 200 len: 1573 microversion: 2.1 time: 0.311738 Apr 14 17:27:30 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 312/941] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:27:29 2023] GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b => generated 1573 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 17:27:30 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ce59e7-b263-4e0b-9f19-638db9606c7b", "name": "network-vif-unplugged", "status": "completed", "tag": "7549a60b-8755-4baa-bf6b-6571c0cbb88b"}, {"server_uuid": "15ce59e7-b263-4e0b-9f19-638db9606c7b", "name": "network-vif-plugged", "status": "completed", "tag": "7549a60b-8755-4baa-bf6b-6571c0cbb88b"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:27:30 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:30 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:30 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:30 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] Creating event network-vif-unplugged:7549a60b-8755-4baa-bf6b-6571c0cbb88b for instance 15ce59e7-b263-4e0b-9f19-638db9606c7b on user Apr 14 17:27:30 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] Creating event network-vif-plugged:7549a60b-8755-4baa-bf6b-6571c0cbb88b for instance 15ce59e7-b263-4e0b-9f19-638db9606c7b on user Apr 14 17:27:30 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-3bc1f6ef-cdbe-4150-addf-6ebe42cb66ec req-d79fcae6-426e-4806-98e9-1a35c89ea8a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030040 Apr 14 17:27:30 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 313/942] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:27:30 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:27:31 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-db5b500c-fae8-4da9-8e7b-8d5a1ebb0012 req-fbeecb72-b74c-4507-8f01-8d9120bdfb0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b83ea6-ac75-48ad-b452-0e74151e1e1c", "name": "network-vif-plugged", "status": "completed", "tag": "1073478a-c9c5-4548-8276-ba9edb79833e"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:27:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-db5b500c-fae8-4da9-8e7b-8d5a1ebb0012 req-fbeecb72-b74c-4507-8f01-8d9120bdfb0e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-db5b500c-fae8-4da9-8e7b-8d5a1ebb0012 req-fbeecb72-b74c-4507-8f01-8d9120bdfb0e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:31 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-db5b500c-fae8-4da9-8e7b-8d5a1ebb0012 req-fbeecb72-b74c-4507-8f01-8d9120bdfb0e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:31 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-db5b500c-fae8-4da9-8e7b-8d5a1ebb0012 req-fbeecb72-b74c-4507-8f01-8d9120bdfb0e service nova] Creating event network-vif-plugged:1073478a-c9c5-4548-8276-ba9edb79833e for instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c on user Apr 14 17:27:31 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-db5b500c-fae8-4da9-8e7b-8d5a1ebb0012 req-fbeecb72-b74c-4507-8f01-8d9120bdfb0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037798 Apr 14 17:27:31 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 318/943] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:27:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:27:32 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-2bee1990-e4c2-4b53-a384-940d9a79cbb5 req-8aebb3ff-69d5-4a12-beb2-12b7bee070b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ce59e7-b263-4e0b-9f19-638db9606c7b", "name": "network-vif-deleted", "tag": "7549a60b-8755-4baa-bf6b-6571c0cbb88b"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:27:32 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-2bee1990-e4c2-4b53-a384-940d9a79cbb5 req-8aebb3ff-69d5-4a12-beb2-12b7bee070b2 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:32 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-2bee1990-e4c2-4b53-a384-940d9a79cbb5 req-8aebb3ff-69d5-4a12-beb2-12b7bee070b2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:32 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-2bee1990-e4c2-4b53-a384-940d9a79cbb5 req-8aebb3ff-69d5-4a12-beb2-12b7bee070b2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:32 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-2bee1990-e4c2-4b53-a384-940d9a79cbb5 req-8aebb3ff-69d5-4a12-beb2-12b7bee070b2 service nova] Creating event network-vif-deleted:7549a60b-8755-4baa-bf6b-6571c0cbb88b for instance 15ce59e7-b263-4e0b-9f19-638db9606c7b on user Apr 14 17:27:32 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-2bee1990-e4c2-4b53-a384-940d9a79cbb5 req-8aebb3ff-69d5-4a12-beb2-12b7bee070b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027439 Apr 14 17:27:32 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 313/944] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:27:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:27:33 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-a974c2c8-c99e-4068-9ea3-199bb953be97 req-6b299690-b37e-429d-998d-ce36b0706e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b83ea6-ac75-48ad-b452-0e74151e1e1c", "name": "network-vif-plugged", "status": "completed", "tag": "1073478a-c9c5-4548-8276-ba9edb79833e"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:27:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a974c2c8-c99e-4068-9ea3-199bb953be97 req-6b299690-b37e-429d-998d-ce36b0706e45 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a974c2c8-c99e-4068-9ea3-199bb953be97 req-6b299690-b37e-429d-998d-ce36b0706e45 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a974c2c8-c99e-4068-9ea3-199bb953be97 req-6b299690-b37e-429d-998d-ce36b0706e45 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:33 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-a974c2c8-c99e-4068-9ea3-199bb953be97 req-6b299690-b37e-429d-998d-ce36b0706e45 service nova] Creating event network-vif-plugged:1073478a-c9c5-4548-8276-ba9edb79833e for instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c on user Apr 14 17:27:33 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-a974c2c8-c99e-4068-9ea3-199bb953be97 req-6b299690-b37e-429d-998d-ce36b0706e45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032036 Apr 14 17:27:33 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 314/945] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:27:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 17:27:42 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:42 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:42 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:42 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:42 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a8f26ad5-1ef3-4913-8c5e-058e0b74c1d7 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:27:42 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-a8f26ad5-1ef3-4913-8c5e-058e0b74c1d7 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: 5c01d750-5923-4b61-9f3a-17cf1142f0a5] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:27:42 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a8f26ad5-1ef3-4913-8c5e-058e0b74c1d7 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:42 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a8f26ad5-1ef3-4913-8c5e-058e0b74c1d7 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:42 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a8f26ad5-1ef3-4913-8c5e-058e0b74c1d7 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:42 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a8f26ad5-1ef3-4913-8c5e-058e0b74c1d7 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:42 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a8f26ad5-1ef3-4913-8c5e-058e0b74c1d7 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:42 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a8f26ad5-1ef3-4913-8c5e-058e0b74c1d7 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:42 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-a8f26ad5-1ef3-4913-8c5e-058e0b74c1d7 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] HTTP exception thrown: Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 could not be found. Apr 14 17:27:42 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a8f26ad5-1ef3-4913-8c5e-058e0b74c1d7 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Request method failure captured: Apr 14 17:27:42 user devstack@n-api.service[61935]: request: GET /compute/v2.1/servers/5c01d750-5923-4b61-9f3a-17cf1142f0a5 HTTP/1.1 Apr 14 17:27:42 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:27:42 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:27:42 user devstack@n-api.service[61935]: Connection: close Apr 14 17:27:42 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:27:42 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:27:42 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:27:42 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:27:42 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:27:42 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYkVBClkxIawkM1nyUWU7TVOYrVEr-N9nAU0PhEuzEE_-YQvgNuTftESHpChD4G1-5d4DpIA7CkgTQ_FGsRsbu8wQIBOC8wC2te9X-DHMsSVpuMD-5ffx2BY9NFTVd25q-U7totKdOrSDVAhHx_Uazr6ZqvpJMFsWKYTM7zuiuFUAR8 Apr 14 17:27:42 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:27:42 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:27:42 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:27:42 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:27:42 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:27:42 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:27:42 user devstack@n-api.service[61935]: X-Project-Id: 070c6b9f620548b183904d1971f35752 Apr 14 17:27:42 user devstack@n-api.service[61935]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2056337871 Apr 14 17:27:42 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:27:42 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:27:42 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/070c6b9f620548b183904d1971f35752"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/070c6b9f620548b183904d1971f35752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/070c6b9f620548b183904d1971f35752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:27:42 user devstack@n-api.service[61935]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2056337871 Apr 14 17:27:42 user devstack@n-api.service[61935]: X-Tenant-Id: 070c6b9f620548b183904d1971f35752 Apr 14 17:27:42 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2056337871 Apr 14 17:27:42 user devstack@n-api.service[61935]: X-User: tempest-ServerRescueNegativeTestJSON-2056337871-project-member Apr 14 17:27:42 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:27:42 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:27:42 user devstack@n-api.service[61935]: X-User-Id: 2434278fe61447fab1f5a930aa16a1de Apr 14 17:27:42 user devstack@n-api.service[61935]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2056337871-project-member Apr 14 17:27:42 user devstack@n-api.service[61935]: method: > Apr 14 17:27:42 user devstack@n-api.service[61935]: exception: Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 could not be found. Apr 14 17:27:42 user devstack@n-api.service[61935]: action_args: {'id': '5c01d750-5923-4b61-9f3a-17cf1142f0a5'} Apr 14 17:27:42 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 could not be found. Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 could not be found. Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 could not be found. Apr 14 17:27:42 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:27:42 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a8f26ad5-1ef3-4913-8c5e-058e0b74c1d7 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Returning 404 to user: Instance 5c01d750-5923-4b61-9f3a-17cf1142f0a5 could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:27:42 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-a8f26ad5-1ef3-4913-8c5e-058e0b74c1d7 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c01d750-5923-4b61-9f3a-17cf1142f0a5" status: 404 len: 111 microversion: 2.1 time: 0.198177 Apr 14 17:27:42 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 319/946] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:27:42 2023] GET /compute/v2.1/servers/5c01d750-5923-4b61-9f3a-17cf1142f0a5 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:27:42 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:27:42 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:27:42 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:42 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:42 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:42 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Going to try to terminate instance {{(pid=61933) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:27:42 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d6eb86d0-eb8b-4cff-a6b6-0fd6be9c3352 tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93" status: 204 len: 0 microversion: 2.1 time: 0.116025 Apr 14 17:27:42 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 314/947] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:27:42 2023] DELETE /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:27:42 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:27:42 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-ed4307b1-0e71-408d-831c-a2338d9e0d8d tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:27:42 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-ed4307b1-0e71-408d-831c-a2338d9e0d8d tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:27:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ed4307b1-0e71-408d-831c-a2338d9e0d8d tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ed4307b1-0e71-408d-831c-a2338d9e0d8d tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ed4307b1-0e71-408d-831c-a2338d9e0d8d tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ed4307b1-0e71-408d-831c-a2338d9e0d8d tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ed4307b1-0e71-408d-831c-a2338d9e0d8d tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-ed4307b1-0e71-408d-831c-a2338d9e0d8d tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:43 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-7dbef7c1-6ef4-4c27-b84f-a6bb150a2f2f req-a67b73aa-306b-43b6-909f-e2c5d393bcd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a075e35f-c43c-4e3a-adb2-2e1629079d93", "name": "network-vif-unplugged", "status": "completed", "tag": "1477a3d2-85fc-4f05-83a0-156f88fc4939"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:27:43 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-7dbef7c1-6ef4-4c27-b84f-a6bb150a2f2f req-a67b73aa-306b-43b6-909f-e2c5d393bcd3 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:43 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-7dbef7c1-6ef4-4c27-b84f-a6bb150a2f2f req-a67b73aa-306b-43b6-909f-e2c5d393bcd3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:43 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-7dbef7c1-6ef4-4c27-b84f-a6bb150a2f2f req-a67b73aa-306b-43b6-909f-e2c5d393bcd3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:43 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-ed4307b1-0e71-408d-831c-a2338d9e0d8d tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2434278fe61447fab1f5a930aa16a1de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070c6b9f620548b183904d1971f35752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:27:43 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-ed4307b1-0e71-408d-831c-a2338d9e0d8d tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93" status: 200 len: 1509 microversion: 2.1 time: 0.253824 Apr 14 17:27:43 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 315/948] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:27:42 2023] GET /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93 => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:27:43 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-7dbef7c1-6ef4-4c27-b84f-a6bb150a2f2f req-a67b73aa-306b-43b6-909f-e2c5d393bcd3 service nova] Creating event network-vif-unplugged:1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance a075e35f-c43c-4e3a-adb2-2e1629079d93 on user Apr 14 17:27:43 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-7dbef7c1-6ef4-4c27-b84f-a6bb150a2f2f req-a67b73aa-306b-43b6-909f-e2c5d393bcd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047899 Apr 14 17:27:43 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 320/949] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:27:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:27:45 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a075e35f-c43c-4e3a-adb2-2e1629079d93", "name": "network-vif-plugged", "status": "completed", "tag": "1477a3d2-85fc-4f05-83a0-156f88fc4939"}, {"server_uuid": "a075e35f-c43c-4e3a-adb2-2e1629079d93", "name": "network-vif-plugged", "status": "completed", "tag": "1477a3d2-85fc-4f05-83a0-156f88fc4939"}, {"server_uuid": "a075e35f-c43c-4e3a-adb2-2e1629079d93", "name": "network-vif-plugged", "status": "completed", "tag": "1477a3d2-85fc-4f05-83a0-156f88fc4939"}, {"server_uuid": "a075e35f-c43c-4e3a-adb2-2e1629079d93", "name": "network-vif-deleted", "tag": "1477a3d2-85fc-4f05-83a0-156f88fc4939"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:27:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:27:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:27:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:27:45 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] Creating event network-vif-plugged:1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance a075e35f-c43c-4e3a-adb2-2e1629079d93 on user Apr 14 17:27:45 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] Creating event network-vif-plugged:1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance a075e35f-c43c-4e3a-adb2-2e1629079d93 on user Apr 14 17:27:45 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] Creating event network-vif-plugged:1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance a075e35f-c43c-4e3a-adb2-2e1629079d93 on user Apr 14 17:27:45 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] Creating event network-vif-deleted:1477a3d2-85fc-4f05-83a0-156f88fc4939 for instance a075e35f-c43c-4e3a-adb2-2e1629079d93 on user Apr 14 17:27:45 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-12a331a8-461e-47fc-bbde-ddd74a1a5b1c req-d6ff902b-cbd0-4c6f-87d8-7040d30ca1f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.055355 Apr 14 17:27:45 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 315/950] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:27:45 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:28:04 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-85a88fd2-6854-48ee-a657-7ebc27b7ddfc tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:04 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-85a88fd2-6854-48ee-a657-7ebc27b7ddfc tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] [instance: 15a48598-5e5d-450b-a6c5-d7637a6d8682] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:28:04 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=16 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:28:04 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=18 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:28:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-85a88fd2-6854-48ee-a657-7ebc27b7ddfc tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:28:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-85a88fd2-6854-48ee-a657-7ebc27b7ddfc tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:28:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-85a88fd2-6854-48ee-a657-7ebc27b7ddfc tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:28:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-85a88fd2-6854-48ee-a657-7ebc27b7ddfc tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:28:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-85a88fd2-6854-48ee-a657-7ebc27b7ddfc tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:28:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-85a88fd2-6854-48ee-a657-7ebc27b7ddfc tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:28:04 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-85a88fd2-6854-48ee-a657-7ebc27b7ddfc tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] HTTP exception thrown: Instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 could not be found. Apr 14 17:28:04 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-85a88fd2-6854-48ee-a657-7ebc27b7ddfc tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Request method failure captured: Apr 14 17:28:04 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682 HTTP/1.1 Apr 14 17:28:04 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:28:04 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:28:04 user devstack@n-api.service[61934]: Connection: close Apr 14 17:28:04 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:28:04 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:28:04 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:28:04 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:28:04 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:28:04 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYtDBZl5rWW8RU9q8DH0pUHzGZGV4RliuA1t1AoOFtDV4Pdt3dCUNmRFFwScAZxNT7Ncha8jJRwAtftwRUdUwX-pA-C-HcZt4wv6cgQ6WGNsAVbHP0yC82WUAI8jCL_R-YtY6e6KQtsrR0DyD7_hN1hzIsM6akT9-CD2D5lhsfKmS80 Apr 14 17:28:04 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:28:04 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:28:04 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:28:04 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:28:04 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:28:04 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:28:04 user devstack@n-api.service[61934]: X-Project-Id: f7ab08f97dd54832a7cc975934b1b69f Apr 14 17:28:04 user devstack@n-api.service[61934]: X-Project-Name: tempest-TestStampPattern-872060463 Apr 14 17:28:04 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:28:04 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:28:04 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7ab08f97dd54832a7cc975934b1b69f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7ab08f97dd54832a7cc975934b1b69f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f7ab08f97dd54832a7cc975934b1b69f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:28:04 user devstack@n-api.service[61934]: X-Tenant: tempest-TestStampPattern-872060463 Apr 14 17:28:04 user devstack@n-api.service[61934]: X-Tenant-Id: f7ab08f97dd54832a7cc975934b1b69f Apr 14 17:28:04 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-TestStampPattern-872060463 Apr 14 17:28:04 user devstack@n-api.service[61934]: X-User: tempest-TestStampPattern-872060463-project-member Apr 14 17:28:04 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:28:04 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:28:04 user devstack@n-api.service[61934]: X-User-Id: b8ea39d187c842788168909de203455e Apr 14 17:28:04 user devstack@n-api.service[61934]: X-User-Name: tempest-TestStampPattern-872060463-project-member Apr 14 17:28:04 user devstack@n-api.service[61934]: method: > Apr 14 17:28:04 user devstack@n-api.service[61934]: exception: Instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 could not be found. Apr 14 17:28:04 user devstack@n-api.service[61934]: action_args: {'id': '15a48598-5e5d-450b-a6c5-d7637a6d8682'} Apr 14 17:28:04 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 could not be found. Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 could not be found. Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 could not be found. Apr 14 17:28:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:04 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-85a88fd2-6854-48ee-a657-7ebc27b7ddfc tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Returning 404 to user: Instance 15a48598-5e5d-450b-a6c5-d7637a6d8682 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:28:04 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-85a88fd2-6854-48ee-a657-7ebc27b7ddfc tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682" status: 404 len: 111 microversion: 2.1 time: 0.038886 Apr 14 17:28:04 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 316/951] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:28:03 2023] GET /compute/v2.1/servers/15a48598-5e5d-450b-a6c5-d7637a6d8682 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:28:07 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:28:07 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:28:07 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-b2fdee8f-401e-4722-8ef1-03d5b8355211 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] Calling method '.version_select at 0x7fe19cf5bd00>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:07 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-b2fdee8f-401e-4722-8ef1-03d5b8355211 tempest-TestStampPattern-872060463 tempest-TestStampPattern-872060463-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1893968129" status: 202 len: 0 microversion: 2.1 time: 0.034355 Apr 14 17:28:07 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 321/952] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 17:28:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1893968129 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:28:16 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:28:16 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:28:16 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-6c145ee5-797a-4c5f-a95a-cfce8d97d91a tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:16 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-6c145ee5-797a-4c5f-a95a-cfce8d97d91a tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:28:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6c145ee5-797a-4c5f-a95a-cfce8d97d91a tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:28:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6c145ee5-797a-4c5f-a95a-cfce8d97d91a tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:28:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6c145ee5-797a-4c5f-a95a-cfce8d97d91a tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:28:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6c145ee5-797a-4c5f-a95a-cfce8d97d91a tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:28:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6c145ee5-797a-4c5f-a95a-cfce8d97d91a tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:28:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6c145ee5-797a-4c5f-a95a-cfce8d97d91a tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:28:16 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-6c145ee5-797a-4c5f-a95a-cfce8d97d91a tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9c6562cb6341e1b4eeebbe95fcb981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a442e486d0ac4ac8ad8205e16f9df504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:28:16 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-6c145ee5-797a-4c5f-a95a-cfce8d97d91a tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34b83ea6-ac75-48ad-b452-0e74151e1e1c" status: 200 len: 1453 microversion: 2.1 time: 0.262269 Apr 14 17:28:16 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 316/953] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:28:16 2023] GET /compute/v2.1/servers/34b83ea6-ac75-48ad-b452-0e74151e1e1c => generated 1453 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:28:17 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a6a99f01-b361-4105-89f0-a06bb81e8e79 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:17 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-a6a99f01-b361-4105-89f0-a06bb81e8e79 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] [instance: 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:28:17 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:28:17 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:28:17 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a6a99f01-b361-4105-89f0-a06bb81e8e79 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:28:17 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a6a99f01-b361-4105-89f0-a06bb81e8e79 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:28:17 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a6a99f01-b361-4105-89f0-a06bb81e8e79 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:28:17 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a6a99f01-b361-4105-89f0-a06bb81e8e79 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:28:17 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a6a99f01-b361-4105-89f0-a06bb81e8e79 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:28:17 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a6a99f01-b361-4105-89f0-a06bb81e8e79 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:28:17 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-a6a99f01-b361-4105-89f0-a06bb81e8e79 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] HTTP exception thrown: Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f could not be found. Apr 14 17:28:17 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a6a99f01-b361-4105-89f0-a06bb81e8e79 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Request method failure captured: Apr 14 17:28:17 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f HTTP/1.1 Apr 14 17:28:17 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:28:17 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:28:17 user devstack@n-api.service[61934]: Connection: close Apr 14 17:28:17 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:28:17 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:28:17 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:28:17 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:28:17 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:28:17 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYhlBGdiNOo9-YaWATboEfHtn-WySFyJ91dSNs3_y6VgRKA5MuH7pTTMFPZc23dWKc9h9zq4g7g0Wd5Ex-b3mMLpJSBrXd9V9Q22t1x2hbcTm1FdeAFUp0K4xl-5CqDN7BUzXYdKnKPYmeDdU8b-W-6svZe_Q7TzkQpEEMJOoxgNUMI Apr 14 17:28:17 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:28:17 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:28:17 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:28:17 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:28:17 user devstack@n-api.service[61934]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 17:28:17 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:28:17 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:28:17 user devstack@n-api.service[61934]: X-Project-Id: 965bd22f61df40bd89e8ef35fb12bcd3 Apr 14 17:28:17 user devstack@n-api.service[61934]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-995212803 Apr 14 17:28:17 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:28:17 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:28:17 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/965bd22f61df40bd89e8ef35fb12bcd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/965bd22f61df40bd89e8ef35fb12bcd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/965bd22f61df40bd89e8ef35fb12bcd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:28:17 user devstack@n-api.service[61934]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-995212803 Apr 14 17:28:17 user devstack@n-api.service[61934]: X-Tenant-Id: 965bd22f61df40bd89e8ef35fb12bcd3 Apr 14 17:28:17 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-995212803 Apr 14 17:28:17 user devstack@n-api.service[61934]: X-User: tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member Apr 14 17:28:17 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:28:17 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:28:17 user devstack@n-api.service[61934]: X-User-Id: b5c86125160643958349100fb3a7855b Apr 14 17:28:17 user devstack@n-api.service[61934]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member Apr 14 17:28:17 user devstack@n-api.service[61934]: method: > Apr 14 17:28:17 user devstack@n-api.service[61934]: exception: Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f could not be found. Apr 14 17:28:17 user devstack@n-api.service[61934]: action_args: {'id': '4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f'} Apr 14 17:28:17 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f could not be found. Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f could not be found. Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f could not be found. Apr 14 17:28:17 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:17 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a6a99f01-b361-4105-89f0-a06bb81e8e79 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] Returning 404 to user: Instance 4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:28:17 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-a6a99f01-b361-4105-89f0-a06bb81e8e79 tempest-ServerBootFromVolumeStableRescueTest-995212803 tempest-ServerBootFromVolumeStableRescueTest-995212803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f" status: 404 len: 111 microversion: 2.87 time: 0.036978 Apr 14 17:28:17 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 317/954] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 17:28:17 2023] GET /compute/v2.1/servers/4441c11d-f7e1-4eea-9bc7-cf54f6a8e53f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 17:28:19 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:28:19 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:28:19 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:28:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:28:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:28:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:28:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:28:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:28:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:28:19 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-92879d53-5dd3-4cc7-b4be-b1b7fcdebed0 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "POST /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752/action" status: 204 len: 0 microversion: 2.1 time: 0.082287 Apr 14 17:28:19 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 322/955] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:28:19 2023] POST /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:28:19 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-53fbe222-c830-4bd0-ad47-b36d796f8d7b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:19 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-53fbe222-c830-4bd0-ad47-b36d796f8d7b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:28:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-53fbe222-c830-4bd0-ad47-b36d796f8d7b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:28:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-53fbe222-c830-4bd0-ad47-b36d796f8d7b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:28:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-53fbe222-c830-4bd0-ad47-b36d796f8d7b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:28:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-53fbe222-c830-4bd0-ad47-b36d796f8d7b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:28:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-53fbe222-c830-4bd0-ad47-b36d796f8d7b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:28:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-53fbe222-c830-4bd0-ad47-b36d796f8d7b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:28:19 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-53fbe222-c830-4bd0-ad47-b36d796f8d7b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:28:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-53fbe222-c830-4bd0-ad47-b36d796f8d7b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752" status: 200 len: 1554 microversion: 2.1 time: 0.417943 Apr 14 17:28:19 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 317/956] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:28:19 2023] GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752 => generated 1554 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 17:28:20 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-15731edb-7d1d-4e2d-a04a-7014f0c79781 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:20 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-15731edb-7d1d-4e2d-a04a-7014f0c79781 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] [instance: 15ce59e7-b263-4e0b-9f19-638db9606c7b] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:28:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-15731edb-7d1d-4e2d-a04a-7014f0c79781 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:28:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-15731edb-7d1d-4e2d-a04a-7014f0c79781 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:28:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-15731edb-7d1d-4e2d-a04a-7014f0c79781 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:28:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-15731edb-7d1d-4e2d-a04a-7014f0c79781 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:28:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-15731edb-7d1d-4e2d-a04a-7014f0c79781 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:28:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-15731edb-7d1d-4e2d-a04a-7014f0c79781 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:28:20 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-15731edb-7d1d-4e2d-a04a-7014f0c79781 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] HTTP exception thrown: Instance 15ce59e7-b263-4e0b-9f19-638db9606c7b could not be found. Apr 14 17:28:20 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-15731edb-7d1d-4e2d-a04a-7014f0c79781 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Request method failure captured: Apr 14 17:28:20 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b HTTP/1.1 Apr 14 17:28:20 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:28:20 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:28:20 user devstack@n-api.service[61934]: Connection: close Apr 14 17:28:20 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:28:20 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:28:20 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:28:20 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:28:20 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:28:20 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYti6_e3m5WQ9th5d0xRrkIUDmrbaOW0Vgq4h3aqGWtUjTnI3_i6y6hySOewCiVpaI_Bi--luFoIdpMlMqyWgsXysUDLrOHgfxctcdkZ8r2G9A1fd6w8rORNRIRo1Ai-HNuE_twXAL6c8KnNpIONiuCZw5ljoobwFr8TNYeh2WeE6us Apr 14 17:28:20 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:28:20 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:28:20 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:28:20 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:28:20 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:28:20 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:28:20 user devstack@n-api.service[61934]: X-Project-Id: 5e3e0c3b9c7b4ca79b75def0f04f5549 Apr 14 17:28:20 user devstack@n-api.service[61934]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1230410658 Apr 14 17:28:20 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:28:20 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:28:20 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5e3e0c3b9c7b4ca79b75def0f04f5549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5e3e0c3b9c7b4ca79b75def0f04f5549"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5e3e0c3b9c7b4ca79b75def0f04f5549"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:28:20 user devstack@n-api.service[61934]: X-Tenant: tempest-SnapshotDataIntegrityTests-1230410658 Apr 14 17:28:20 user devstack@n-api.service[61934]: X-Tenant-Id: 5e3e0c3b9c7b4ca79b75def0f04f5549 Apr 14 17:28:20 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1230410658 Apr 14 17:28:20 user devstack@n-api.service[61934]: X-User: tempest-SnapshotDataIntegrityTests-1230410658-project-member Apr 14 17:28:20 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:28:20 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:28:20 user devstack@n-api.service[61934]: X-User-Id: ecae496b720c4e09b90986969d9ae9fa Apr 14 17:28:20 user devstack@n-api.service[61934]: X-User-Name: tempest-SnapshotDataIntegrityTests-1230410658-project-member Apr 14 17:28:20 user devstack@n-api.service[61934]: method: > Apr 14 17:28:20 user devstack@n-api.service[61934]: exception: Instance 15ce59e7-b263-4e0b-9f19-638db9606c7b could not be found. Apr 14 17:28:20 user devstack@n-api.service[61934]: action_args: {'id': '15ce59e7-b263-4e0b-9f19-638db9606c7b'} Apr 14 17:28:20 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15ce59e7-b263-4e0b-9f19-638db9606c7b could not be found. Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15ce59e7-b263-4e0b-9f19-638db9606c7b could not be found. Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15ce59e7-b263-4e0b-9f19-638db9606c7b could not be found. Apr 14 17:28:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:20 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-15731edb-7d1d-4e2d-a04a-7014f0c79781 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Returning 404 to user: Instance 15ce59e7-b263-4e0b-9f19-638db9606c7b could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:28:20 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-15731edb-7d1d-4e2d-a04a-7014f0c79781 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b" status: 404 len: 111 microversion: 2.1 time: 0.036658 Apr 14 17:28:20 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 318/957] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:28:20 2023] GET /compute/v2.1/servers/15ce59e7-b263-4e0b-9f19-638db9606c7b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:28:20 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-bea5b888-3e29-41b2-83c3-bedb8b84ca18 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] Calling method '.version_select at 0x7fe19cf5ad40>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:20 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-bea5b888-3e29-41b2-83c3-bedb8b84ca18 tempest-SnapshotDataIntegrityTests-1230410658 tempest-SnapshotDataIntegrityTests-1230410658-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1467007685" status: 202 len: 0 microversion: 2.1 time: 0.028366 Apr 14 17:28:20 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 323/958] 10.0.0.210 () {62 vars in 1355 bytes} [Fri Apr 14 17:28:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1467007685 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:28:22 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-a0309ac8-6131-4cf3-a502-946a325d4971 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Action: 'create', calling method: .version_select at 0x7fe19cdb2950>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1796494449"}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:28:23 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-a0309ac8-6131-4cf3-a502-946a325d4971 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.630242 Apr 14 17:28:23 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 318/959] 10.0.0.210 () {64 vars in 1232 bytes} [Fri Apr 14 17:28:22 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 634 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 17:28:23 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-8a2ac8f7-1ac4-46b6-a018-41ead6ea4bbe tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19d0fac20>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:23 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-8a2ac8f7-1ac4-46b6-a018-41ead6ea4bbe tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c" status: 200 len: 345 microversion: 2.1 time: 0.059637 Apr 14 17:28:23 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 319/960] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:28:23 2023] GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:28:24 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-24edf305-4668-4ed4-a66e-397e023487bd tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19cfac4c0>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:24 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-24edf305-4668-4ed4-a66e-397e023487bd tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c" status: 200 len: 345 microversion: 2.1 time: 0.055819 Apr 14 17:28:24 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 324/961] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:28:24 2023] GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:28:25 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-c4371fcc-fa0c-4c3a-8cd7-4bc166b48fa1 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19d07e0e0>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:25 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-c4371fcc-fa0c-4c3a-8cd7-4bc166b48fa1 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c" status: 200 len: 346 microversion: 2.1 time: 0.062895 Apr 14 17:28:25 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 319/962] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:28:25 2023] GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:28:25 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-4e9e0d0b-d1d5-433c-b4d5-58d85c1e3ade tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Action: 'create', calling method: .version_select at 0x7fe19d3c9ea0>, body: {"snapshot": {"volume_id": "134042b9-da6b-45f7-8d53-d2cd07e8561c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-698050285"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:28:25 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-4e9e0d0b-d1d5-433c-b4d5-58d85c1e3ade tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.179621 Apr 14 17:28:25 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 320/963] 10.0.0.210 () {64 vars in 1239 bytes} [Fri Apr 14 17:28:25 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:28:25 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-d70c8be6-c959-465c-8363-b00fc6d620b5 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19cfac0d0>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:25 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-d70c8be6-c959-465c-8363-b00fc6d620b5 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97" status: 200 len: 286 microversion: 2.1 time: 0.042920 Apr 14 17:28:25 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 325/964] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 17:28:25 2023] GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:28:25 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b2d7af8f-293c-45dc-b3a5-e6e4abce5ce8 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19d1339a0>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:25 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-b2d7af8f-293c-45dc-b3a5-e6e4abce5ce8 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.043039 Apr 14 17:28:25 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 320/965] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 17:28:25 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:28:25 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-4eb07e2c-840b-47d5-9544-36346805dc82 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19cef5870>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:25 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-4eb07e2c-840b-47d5-9544-36346805dc82 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97" status: 200 len: 286 microversion: 2.1 time: 0.033136 Apr 14 17:28:25 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 321/966] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 17:28:25 2023] GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:28:26 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-4c9fdb38-2276-4e29-ad27-1eb651d742f8 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19cf5a170>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:26 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-4c9fdb38-2276-4e29-ad27-1eb651d742f8 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97" status: 200 len: 286 microversion: 2.1 time: 0.034977 Apr 14 17:28:26 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 326/967] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 17:28:26 2023] GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:28:27 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-f2273286-d359-4385-ad3c-10cafa566468 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19d15e290>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:27 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-f2273286-d359-4385-ad3c-10cafa566468 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97" status: 200 len: 286 microversion: 2.1 time: 0.043462 Apr 14 17:28:27 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 321/968] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 17:28:27 2023] GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:28:28 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-7d1b8794-4154-4a19-9ece-32f967c7990c tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19cfc79a0>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:28 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-7d1b8794-4154-4a19-9ece-32f967c7990c tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97" status: 200 len: 287 microversion: 2.1 time: 0.039908 Apr 14 17:28:28 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 322/969] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 17:28:28 2023] GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:28:28 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-bf043ddf-8e90-4dea-a9a3-17a0fc0b887b tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19cfafac0>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:28 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-bf043ddf-8e90-4dea-a9a3-17a0fc0b887b tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97" status: 202 len: 0 microversion: 2.1 time: 0.069133 Apr 14 17:28:28 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 327/970] 10.0.0.210 () {62 vars in 1331 bytes} [Fri Apr 14 17:28:28 2023] DELETE /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:28:28 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-bb7c57a9-a1e1-4ab3-87cb-384347579461 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19cdb2ef0>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:28 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-bb7c57a9-a1e1-4ab3-87cb-384347579461 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97" status: 200 len: 286 microversion: 2.1 time: 0.053893 Apr 14 17:28:28 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 322/971] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 17:28:28 2023] GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97 => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:28:29 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-9b19e48d-beac-4d09-9bbe-559719999e53 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19d0fb7f0>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:29 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-9b19e48d-beac-4d09-9bbe-559719999e53 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97" status: 200 len: 286 microversion: 2.1 time: 0.033966 Apr 14 17:28:29 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 323/972] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 17:28:29 2023] GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:28:30 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:28:30 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:28:30 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-23dee320-8b1c-4c45-bbf5-69e09d9d57dc tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19cfae830>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:31 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-23dee320-8b1c-4c45-bbf5-69e09d9d57dc tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97" status: 200 len: 286 microversion: 2.1 time: 0.038822 Apr 14 17:28:31 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 328/973] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 17:28:30 2023] GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:28:32 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:28:32 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=12 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:28:32 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-ca208e55-0c02-4f71-b266-c5ecddb55c8b tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19d07d510>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:32 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-ca208e55-0c02-4f71-b266-c5ecddb55c8b tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] HTTP exception thrown: Snapshot ad557a86-8587-4b30-8271-b43d5bbbde97 could not be found. Apr 14 17:28:32 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-ca208e55-0c02-4f71-b266-c5ecddb55c8b tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Request method failure captured: Apr 14 17:28:32 user devstack@n-api.service[61933]: request: GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97 HTTP/1.1 Apr 14 17:28:32 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:28:32 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:28:32 user devstack@n-api.service[61933]: Connection: close Apr 14 17:28:32 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:28:32 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:28:32 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:28:32 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:28:32 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:28:32 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOY02mT6AzuS5InNwI9ZwFY8BuVssBkgxOPqxGxsAhfgImrPSMj1FVr2yl7kazWNgxO4EHuMHSZUakovLjXOh8nwqZYAjtCQIQW9wXxIMtjzhBVvT4EQaD6Xnn8iCoHdIoIA_e4T0B5rB8ALJ_cTBPRQJAyfq5boh6XTf3j5cflYB_NM Apr 14 17:28:32 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:28:32 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:28:32 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:28:32 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:28:32 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:28:32 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:28:32 user devstack@n-api.service[61933]: X-Project-Id: d47508af26774a2bb2f1244720d41693 Apr 14 17:28:32 user devstack@n-api.service[61933]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1763390958 Apr 14 17:28:32 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:28:32 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:28:32 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d47508af26774a2bb2f1244720d41693"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d47508af26774a2bb2f1244720d41693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d47508af26774a2bb2f1244720d41693"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:28:32 user devstack@n-api.service[61933]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1763390958 Apr 14 17:28:32 user devstack@n-api.service[61933]: X-Tenant-Id: d47508af26774a2bb2f1244720d41693 Apr 14 17:28:32 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1763390958 Apr 14 17:28:32 user devstack@n-api.service[61933]: X-User: tempest-VolumesSnapshotsTestJSON-1763390958-project-member Apr 14 17:28:32 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:28:32 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:28:32 user devstack@n-api.service[61933]: X-User-Id: 6cda999ce0d1485a8c89351fbfc65bfb Apr 14 17:28:32 user devstack@n-api.service[61933]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1763390958-project-member Apr 14 17:28:32 user devstack@n-api.service[61933]: method: Apr 14 17:28:32 user devstack@n-api.service[61933]: exception: Snapshot ad557a86-8587-4b30-8271-b43d5bbbde97 could not be found. Apr 14 17:28:32 user devstack@n-api.service[61933]: action_args: {'id': 'ad557a86-8587-4b30-8271-b43d5bbbde97'} Apr 14 17:28:32 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ad557a86-8587-4b30-8271-b43d5bbbde97 could not be found. (HTTP 404) (Request-ID: req-3e77f594-59cc-48a0-bb8c-f890cadfdcda) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ad557a86-8587-4b30-8271-b43d5bbbde97 could not be found. Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ad557a86-8587-4b30-8271-b43d5bbbde97 could not be found. Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ad557a86-8587-4b30-8271-b43d5bbbde97 could not be found. Apr 14 17:28:32 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:32 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-ca208e55-0c02-4f71-b266-c5ecddb55c8b tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Returning 404 to user: Snapshot ad557a86-8587-4b30-8271-b43d5bbbde97 could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:28:32 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-ca208e55-0c02-4f71-b266-c5ecddb55c8b tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97" status: 404 len: 111 microversion: 2.1 time: 0.064358 Apr 14 17:28:32 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 323/974] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 17:28:32 2023] GET /compute/v2.1/os-snapshots/ad557a86-8587-4b30-8271-b43d5bbbde97 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:28:32 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:28:32 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:28:32 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-2139c0df-0927-4a6f-9937-4c1ec92a3602 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19d1971c0>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:32 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-2139c0df-0927-4a6f-9937-4c1ec92a3602 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c" status: 202 len: 0 microversion: 2.1 time: 0.069523 Apr 14 17:28:32 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 324/975] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 17:28:32 2023] DELETE /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:28:32 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-40e9c8ea-6242-4288-86be-0cb171ff4b11 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19cfadcf0>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:32 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-40e9c8ea-6242-4288-86be-0cb171ff4b11 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c" status: 200 len: 345 microversion: 2.1 time: 0.062797 Apr 14 17:28:32 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 329/976] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:28:32 2023] GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:28:33 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b9761487-3447-4ddf-9039-b46f9d88abaf tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:33 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-b9761487-3447-4ddf-9039-b46f9d88abaf tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] [instance: a075e35f-c43c-4e3a-adb2-2e1629079d93] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:28:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b9761487-3447-4ddf-9039-b46f9d88abaf tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:28:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b9761487-3447-4ddf-9039-b46f9d88abaf tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:28:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b9761487-3447-4ddf-9039-b46f9d88abaf tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:28:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b9761487-3447-4ddf-9039-b46f9d88abaf tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:28:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b9761487-3447-4ddf-9039-b46f9d88abaf tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:28:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b9761487-3447-4ddf-9039-b46f9d88abaf tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:28:33 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-b9761487-3447-4ddf-9039-b46f9d88abaf tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] HTTP exception thrown: Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 could not be found. Apr 14 17:28:33 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b9761487-3447-4ddf-9039-b46f9d88abaf tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Request method failure captured: Apr 14 17:28:33 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93 HTTP/1.1 Apr 14 17:28:33 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:28:33 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:28:33 user devstack@n-api.service[61933]: Connection: close Apr 14 17:28:33 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:28:33 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:28:33 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:28:33 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:28:33 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:28:33 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYkVBClkxIawkM1nyUWU7TVOYrVEr-N9nAU0PhEuzEE_-YQvgNuTftESHpChD4G1-5d4DpIA7CkgTQ_FGsRsbu8wQIBOC8wC2te9X-DHMsSVpuMD-5ffx2BY9NFTVd25q-U7totKdOrSDVAhHx_Uazr6ZqvpJMFsWKYTM7zuiuFUAR8 Apr 14 17:28:33 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:28:33 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:28:33 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:28:33 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:28:33 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:28:33 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:28:33 user devstack@n-api.service[61933]: X-Project-Id: 070c6b9f620548b183904d1971f35752 Apr 14 17:28:33 user devstack@n-api.service[61933]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2056337871 Apr 14 17:28:33 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:28:33 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:28:33 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/070c6b9f620548b183904d1971f35752"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/070c6b9f620548b183904d1971f35752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/070c6b9f620548b183904d1971f35752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:28:33 user devstack@n-api.service[61933]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2056337871 Apr 14 17:28:33 user devstack@n-api.service[61933]: X-Tenant-Id: 070c6b9f620548b183904d1971f35752 Apr 14 17:28:33 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2056337871 Apr 14 17:28:33 user devstack@n-api.service[61933]: X-User: tempest-ServerRescueNegativeTestJSON-2056337871-project-member Apr 14 17:28:33 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:28:33 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:28:33 user devstack@n-api.service[61933]: X-User-Id: 2434278fe61447fab1f5a930aa16a1de Apr 14 17:28:33 user devstack@n-api.service[61933]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2056337871-project-member Apr 14 17:28:33 user devstack@n-api.service[61933]: method: > Apr 14 17:28:33 user devstack@n-api.service[61933]: exception: Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 could not be found. Apr 14 17:28:33 user devstack@n-api.service[61933]: action_args: {'id': 'a075e35f-c43c-4e3a-adb2-2e1629079d93'} Apr 14 17:28:33 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 could not be found. Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 could not be found. Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 could not be found. Apr 14 17:28:33 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:33 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b9761487-3447-4ddf-9039-b46f9d88abaf tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] Returning 404 to user: Instance a075e35f-c43c-4e3a-adb2-2e1629079d93 could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:28:33 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-b9761487-3447-4ddf-9039-b46f9d88abaf tempest-ServerRescueNegativeTestJSON-2056337871 tempest-ServerRescueNegativeTestJSON-2056337871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93" status: 404 len: 111 microversion: 2.1 time: 0.056338 Apr 14 17:28:33 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 324/977] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:28:33 2023] GET /compute/v2.1/servers/a075e35f-c43c-4e3a-adb2-2e1629079d93 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:28:33 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-1b269b77-77fd-4bf8-9f17-e34c2f7dd68d tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19d0fac20>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:33 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-1b269b77-77fd-4bf8-9f17-e34c2f7dd68d tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c" status: 200 len: 345 microversion: 2.1 time: 0.053269 Apr 14 17:28:33 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 325/978] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:28:33 2023] GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:28:34 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-aa5121b5-c0e6-40c4-98d2-651067eafd47 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19d1cfc70>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:34 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-aa5121b5-c0e6-40c4-98d2-651067eafd47 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c" status: 200 len: 345 microversion: 2.1 time: 0.061142 Apr 14 17:28:34 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 330/979] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:28:34 2023] GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:28:35 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-6f93ef11-3943-4623-83c1-97f11d5f8b90 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19d133490>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:35 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-6f93ef11-3943-4623-83c1-97f11d5f8b90 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c" status: 200 len: 345 microversion: 2.1 time: 0.089672 Apr 14 17:28:35 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 325/980] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:28:35 2023] GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c => generated 345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:28:36 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-f766bada-3add-40d0-99f0-fe089809ab83 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19cef6050>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:36 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-f766bada-3add-40d0-99f0-fe089809ab83 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] HTTP exception thrown: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. Apr 14 17:28:36 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-f766bada-3add-40d0-99f0-fe089809ab83 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Request method failure captured: Apr 14 17:28:36 user devstack@n-api.service[61934]: request: GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c HTTP/1.1 Apr 14 17:28:36 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:28:36 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:28:36 user devstack@n-api.service[61934]: Connection: close Apr 14 17:28:36 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:28:36 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:28:36 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:28:36 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:28:36 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:28:36 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOY02mT6AzuS5InNwI9ZwFY8BuVssBkgxOPqxGxsAhfgImrPSMj1FVr2yl7kazWNgxO4EHuMHSZUakovLjXOh8nwqZYAjtCQIQW9wXxIMtjzhBVvT4EQaD6Xnn8iCoHdIoIA_e4T0B5rB8ALJ_cTBPRQJAyfq5boh6XTf3j5cflYB_NM Apr 14 17:28:36 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:28:36 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:28:36 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:28:36 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:28:36 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:28:36 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:28:36 user devstack@n-api.service[61934]: X-Project-Id: d47508af26774a2bb2f1244720d41693 Apr 14 17:28:36 user devstack@n-api.service[61934]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1763390958 Apr 14 17:28:36 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:28:36 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:28:36 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d47508af26774a2bb2f1244720d41693"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d47508af26774a2bb2f1244720d41693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d47508af26774a2bb2f1244720d41693"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:28:36 user devstack@n-api.service[61934]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1763390958 Apr 14 17:28:36 user devstack@n-api.service[61934]: X-Tenant-Id: d47508af26774a2bb2f1244720d41693 Apr 14 17:28:36 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1763390958 Apr 14 17:28:36 user devstack@n-api.service[61934]: X-User: tempest-VolumesSnapshotsTestJSON-1763390958-project-member Apr 14 17:28:36 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:28:36 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:28:36 user devstack@n-api.service[61934]: X-User-Id: 6cda999ce0d1485a8c89351fbfc65bfb Apr 14 17:28:36 user devstack@n-api.service[61934]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1763390958-project-member Apr 14 17:28:36 user devstack@n-api.service[61934]: method: Apr 14 17:28:36 user devstack@n-api.service[61934]: exception: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. Apr 14 17:28:36 user devstack@n-api.service[61934]: action_args: {'id': '134042b9-da6b-45f7-8d53-d2cd07e8561c'} Apr 14 17:28:36 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. (HTTP 404) (Request-ID: req-a9a7c4e2-d954-4ff7-95ac-eff1c8ac32df) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. Apr 14 17:28:36 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-f766bada-3add-40d0-99f0-fe089809ab83 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Returning 404 to user: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:28:36 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-f766bada-3add-40d0-99f0-fe089809ab83 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c" status: 404 len: 109 microversion: 2.1 time: 0.057605 Apr 14 17:28:36 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 326/981] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:28:36 2023] GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:28:36 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-fc7f0561-0850-40d7-8e73-944cabfa33f1 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19cfacc10>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:36 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-fc7f0561-0850-40d7-8e73-944cabfa33f1 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] HTTP exception thrown: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. Apr 14 17:28:36 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-fc7f0561-0850-40d7-8e73-944cabfa33f1 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Request method failure captured: Apr 14 17:28:36 user devstack@n-api.service[61935]: request: DELETE /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c HTTP/1.1 Apr 14 17:28:36 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:28:36 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:28:36 user devstack@n-api.service[61935]: Connection: close Apr 14 17:28:36 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:28:36 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:28:36 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:28:36 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:28:36 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:28:36 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOY02mT6AzuS5InNwI9ZwFY8BuVssBkgxOPqxGxsAhfgImrPSMj1FVr2yl7kazWNgxO4EHuMHSZUakovLjXOh8nwqZYAjtCQIQW9wXxIMtjzhBVvT4EQaD6Xnn8iCoHdIoIA_e4T0B5rB8ALJ_cTBPRQJAyfq5boh6XTf3j5cflYB_NM Apr 14 17:28:36 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:28:36 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:28:36 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:28:36 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:28:36 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:28:36 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:28:36 user devstack@n-api.service[61935]: X-Project-Id: d47508af26774a2bb2f1244720d41693 Apr 14 17:28:36 user devstack@n-api.service[61935]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1763390958 Apr 14 17:28:36 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:28:36 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:28:36 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d47508af26774a2bb2f1244720d41693"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d47508af26774a2bb2f1244720d41693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d47508af26774a2bb2f1244720d41693"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:28:36 user devstack@n-api.service[61935]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1763390958 Apr 14 17:28:36 user devstack@n-api.service[61935]: X-Tenant-Id: d47508af26774a2bb2f1244720d41693 Apr 14 17:28:36 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1763390958 Apr 14 17:28:36 user devstack@n-api.service[61935]: X-User: tempest-VolumesSnapshotsTestJSON-1763390958-project-member Apr 14 17:28:36 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:28:36 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:28:36 user devstack@n-api.service[61935]: X-User-Id: 6cda999ce0d1485a8c89351fbfc65bfb Apr 14 17:28:36 user devstack@n-api.service[61935]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1763390958-project-member Apr 14 17:28:36 user devstack@n-api.service[61935]: method: Apr 14 17:28:36 user devstack@n-api.service[61935]: exception: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. Apr 14 17:28:36 user devstack@n-api.service[61935]: action_args: {'id': '134042b9-da6b-45f7-8d53-d2cd07e8561c'} Apr 14 17:28:36 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. (HTTP 404) (Request-ID: req-22700978-5c59-4cb4-b3c8-c52a21b56416) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. Apr 14 17:28:36 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-fc7f0561-0850-40d7-8e73-944cabfa33f1 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Returning 404 to user: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:28:36 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-fc7f0561-0850-40d7-8e73-944cabfa33f1 tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c" status: 404 len: 109 microversion: 2.1 time: 0.042257 Apr 14 17:28:36 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 331/982] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 17:28:36 2023] DELETE /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:28:36 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-8a9f9b0d-59d3-47cf-9697-2bc27b53a73f tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Calling method '.version_select at 0x7fe19cf02e60>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:36 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-8a9f9b0d-59d3-47cf-9697-2bc27b53a73f tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] HTTP exception thrown: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. Apr 14 17:28:36 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-8a9f9b0d-59d3-47cf-9697-2bc27b53a73f tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Request method failure captured: Apr 14 17:28:36 user devstack@n-api.service[61933]: request: GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c HTTP/1.1 Apr 14 17:28:36 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:28:36 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:28:36 user devstack@n-api.service[61933]: Connection: close Apr 14 17:28:36 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:28:36 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:28:36 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:28:36 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:28:36 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:28:36 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOY02mT6AzuS5InNwI9ZwFY8BuVssBkgxOPqxGxsAhfgImrPSMj1FVr2yl7kazWNgxO4EHuMHSZUakovLjXOh8nwqZYAjtCQIQW9wXxIMtjzhBVvT4EQaD6Xnn8iCoHdIoIA_e4T0B5rB8ALJ_cTBPRQJAyfq5boh6XTf3j5cflYB_NM Apr 14 17:28:36 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:28:36 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:28:36 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:28:36 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:28:36 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:28:36 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:28:36 user devstack@n-api.service[61933]: X-Project-Id: d47508af26774a2bb2f1244720d41693 Apr 14 17:28:36 user devstack@n-api.service[61933]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1763390958 Apr 14 17:28:36 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:28:36 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:28:36 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d47508af26774a2bb2f1244720d41693"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d47508af26774a2bb2f1244720d41693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d47508af26774a2bb2f1244720d41693"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:28:36 user devstack@n-api.service[61933]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1763390958 Apr 14 17:28:36 user devstack@n-api.service[61933]: X-Tenant-Id: d47508af26774a2bb2f1244720d41693 Apr 14 17:28:36 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1763390958 Apr 14 17:28:36 user devstack@n-api.service[61933]: X-User: tempest-VolumesSnapshotsTestJSON-1763390958-project-member Apr 14 17:28:36 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:28:36 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:28:36 user devstack@n-api.service[61933]: X-User-Id: 6cda999ce0d1485a8c89351fbfc65bfb Apr 14 17:28:36 user devstack@n-api.service[61933]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1763390958-project-member Apr 14 17:28:36 user devstack@n-api.service[61933]: method: Apr 14 17:28:36 user devstack@n-api.service[61933]: exception: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. Apr 14 17:28:36 user devstack@n-api.service[61933]: action_args: {'id': '134042b9-da6b-45f7-8d53-d2cd07e8561c'} Apr 14 17:28:36 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. (HTTP 404) (Request-ID: req-a74c3fa5-2471-4e86-bc0e-bc5c890936ba) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. Apr 14 17:28:36 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:28:36 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-8a9f9b0d-59d3-47cf-9697-2bc27b53a73f tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] Returning 404 to user: Volume 134042b9-da6b-45f7-8d53-d2cd07e8561c could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:28:36 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-8a9f9b0d-59d3-47cf-9697-2bc27b53a73f tempest-VolumesSnapshotsTestJSON-1763390958 tempest-VolumesSnapshotsTestJSON-1763390958-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c" status: 404 len: 109 microversion: 2.1 time: 0.052660 Apr 14 17:28:36 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 326/983] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:28:36 2023] GET /compute/v2.1/os-volumes/134042b9-da6b-45f7-8d53-d2cd07e8561c => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:28:55 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1807197706", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "networks": [{"uuid": "777a6d32-2983-4b6e-844a-655be73af980"}]}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:28:55 user devstack@n-api.service[61934]: DEBUG nova.network.neutron [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] validate_networks() for [('777a6d32-2983-4b6e-844a-655be73af980', None, None, None, None, None)] {{(pid=61934) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:28:55 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:28:55 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:28:55 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:28:55 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:28:55 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:28:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:28:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:28:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:28:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:28:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:28:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:28:55 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Getting quotas for project 360f9e856f81453b80189e456a2269fe. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:28:55 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Getting quotas for user f554e014a05a40c4bd070b4494314e33 and project 360f9e856f81453b80189e456a2269fe. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:28:55 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Going to run 1 instances... {{(pid=61934) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:28:55 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:28:56 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-fc36f1b5-781f-4345-a8eb-6c350657b1ae tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.630648 Apr 14 17:28:56 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 327/984] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:28:55 2023] POST /compute/v2.1/servers => generated 378 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:28:56 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-b4e69020-2042-4701-a51f-5f151841d76f tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:28:56 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-b4e69020-2042-4701-a51f-5f151841d76f tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:28:56 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-b4e69020-2042-4701-a51f-5f151841d76f tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554e014a05a40c4bd070b4494314e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f9e856f81453b80189e456a2269fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:28:56 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-b4e69020-2042-4701-a51f-5f151841d76f tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29e0fe26-16f6-47b3-858b-37ff677de04f" status: 200 len: 1213 microversion: 2.1 time: 0.080832 Apr 14 17:28:56 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 332/985] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:28:56 2023] GET /compute/v2.1/servers/29e0fe26-16f6-47b3-858b-37ff677de04f => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:28:58 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-05592078-aff7-4560-8a34-f24ed901ad38 req-dee0f8a9-977e-4cc7-a97e-2a23623cca1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e0fe26-16f6-47b3-858b-37ff677de04f", "tag": "500493ce-d3d4-47c3-99dc-06c6fabf828c"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:28:58 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:28:58 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:28:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-05592078-aff7-4560-8a34-f24ed901ad38 req-dee0f8a9-977e-4cc7-a97e-2a23623cca1e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:28:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-05592078-aff7-4560-8a34-f24ed901ad38 req-dee0f8a9-977e-4cc7-a97e-2a23623cca1e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:28:58 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-05592078-aff7-4560-8a34-f24ed901ad38 req-dee0f8a9-977e-4cc7-a97e-2a23623cca1e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:28:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-05592078-aff7-4560-8a34-f24ed901ad38 req-dee0f8a9-977e-4cc7-a97e-2a23623cca1e service nova] Creating event network-changed:500493ce-d3d4-47c3-99dc-06c6fabf828c for instance 29e0fe26-16f6-47b3-858b-37ff677de04f on user Apr 14 17:28:58 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-05592078-aff7-4560-8a34-f24ed901ad38 req-dee0f8a9-977e-4cc7-a97e-2a23623cca1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038829 Apr 14 17:28:58 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 327/986] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:28:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:29:00 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-11a11463-f394-418a-84fb-e394ac6a20d5 req-0f385545-a444-4f88-b9a1-4aed7bcba6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e0fe26-16f6-47b3-858b-37ff677de04f", "name": "network-vif-plugged", "status": "completed", "tag": "500493ce-d3d4-47c3-99dc-06c6fabf828c"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:29:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-11a11463-f394-418a-84fb-e394ac6a20d5 req-0f385545-a444-4f88-b9a1-4aed7bcba6f1 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:29:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-11a11463-f394-418a-84fb-e394ac6a20d5 req-0f385545-a444-4f88-b9a1-4aed7bcba6f1 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:29:00 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-11a11463-f394-418a-84fb-e394ac6a20d5 req-0f385545-a444-4f88-b9a1-4aed7bcba6f1 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:29:00 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-11a11463-f394-418a-84fb-e394ac6a20d5 req-0f385545-a444-4f88-b9a1-4aed7bcba6f1 service nova] Creating event network-vif-plugged:500493ce-d3d4-47c3-99dc-06c6fabf828c for instance 29e0fe26-16f6-47b3-858b-37ff677de04f on user Apr 14 17:29:00 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-11a11463-f394-418a-84fb-e394ac6a20d5 req-0f385545-a444-4f88-b9a1-4aed7bcba6f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033489 Apr 14 17:29:00 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 328/987] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:29:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:29:02 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-85682d78-cb07-4334-bdbb-15b8c68fed2a req-35322357-4b58-4301-9944-67efc16d3bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e0fe26-16f6-47b3-858b-37ff677de04f", "name": "network-vif-plugged", "status": "completed", "tag": "500493ce-d3d4-47c3-99dc-06c6fabf828c"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:29:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-85682d78-cb07-4334-bdbb-15b8c68fed2a req-35322357-4b58-4301-9944-67efc16d3bce service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:29:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-85682d78-cb07-4334-bdbb-15b8c68fed2a req-35322357-4b58-4301-9944-67efc16d3bce service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:29:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-85682d78-cb07-4334-bdbb-15b8c68fed2a req-35322357-4b58-4301-9944-67efc16d3bce service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:29:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-85682d78-cb07-4334-bdbb-15b8c68fed2a req-35322357-4b58-4301-9944-67efc16d3bce service nova] Creating event network-vif-plugged:500493ce-d3d4-47c3-99dc-06c6fabf828c for instance 29e0fe26-16f6-47b3-858b-37ff677de04f on user Apr 14 17:29:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-85682d78-cb07-4334-bdbb-15b8c68fed2a req-35322357-4b58-4301-9944-67efc16d3bce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030691 Apr 14 17:29:02 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 333/988] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:29:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:29:09 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:29:09 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:29:09 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-1ca33785-2c8d-4aa1-a3f9-1178ebca7530 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:29:09 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-1ca33785-2c8d-4aa1-a3f9-1178ebca7530 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:29:09 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1ca33785-2c8d-4aa1-a3f9-1178ebca7530 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:29:09 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1ca33785-2c8d-4aa1-a3f9-1178ebca7530 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:29:09 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1ca33785-2c8d-4aa1-a3f9-1178ebca7530 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:29:09 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1ca33785-2c8d-4aa1-a3f9-1178ebca7530 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:29:09 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1ca33785-2c8d-4aa1-a3f9-1178ebca7530 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:29:09 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-1ca33785-2c8d-4aa1-a3f9-1178ebca7530 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:29:09 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-1ca33785-2c8d-4aa1-a3f9-1178ebca7530 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:29:10 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-1ca33785-2c8d-4aa1-a3f9-1178ebca7530 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752" status: 200 len: 1546 microversion: 2.1 time: 0.240595 Apr 14 17:29:10 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 328/989] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:29:09 2023] GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752 => generated 1546 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:29:16 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:29:16 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:29:16 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:29:16 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:29:16 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:29:16 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:29:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:29:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:29:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:29:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:29:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:29:16 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:29:16 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Going to try to terminate instance {{(pid=61934) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:29:16 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-a1998780-6118-4238-a012-ab29210af5aa tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/34b83ea6-ac75-48ad-b452-0e74151e1e1c" status: 204 len: 0 microversion: 2.1 time: 0.120885 Apr 14 17:29:16 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 329/990] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:29:16 2023] DELETE /compute/v2.1/servers/34b83ea6-ac75-48ad-b452-0e74151e1e1c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:29:16 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:29:16 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:29:16 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:29:16 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-745132a5-8d29-41c3-b04a-aa28834dc04f tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:29:16 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-745132a5-8d29-41c3-b04a-aa28834dc04f tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:29:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-745132a5-8d29-41c3-b04a-aa28834dc04f tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:29:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-745132a5-8d29-41c3-b04a-aa28834dc04f tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:29:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-745132a5-8d29-41c3-b04a-aa28834dc04f tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:29:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-745132a5-8d29-41c3-b04a-aa28834dc04f tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:29:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-745132a5-8d29-41c3-b04a-aa28834dc04f tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:29:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-745132a5-8d29-41c3-b04a-aa28834dc04f tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:29:17 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-3e5ec978-4459-4f1d-b8f9-d13a70036a03 req-853f0064-84cc-4702-b119-0ae3a270aac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b83ea6-ac75-48ad-b452-0e74151e1e1c", "name": "network-vif-unplugged", "status": "completed", "tag": "1073478a-c9c5-4548-8276-ba9edb79833e"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:29:17 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-745132a5-8d29-41c3-b04a-aa28834dc04f tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9c6562cb6341e1b4eeebbe95fcb981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a442e486d0ac4ac8ad8205e16f9df504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:29:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-3e5ec978-4459-4f1d-b8f9-d13a70036a03 req-853f0064-84cc-4702-b119-0ae3a270aac8 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:29:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-3e5ec978-4459-4f1d-b8f9-d13a70036a03 req-853f0064-84cc-4702-b119-0ae3a270aac8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:29:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-3e5ec978-4459-4f1d-b8f9-d13a70036a03 req-853f0064-84cc-4702-b119-0ae3a270aac8 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:29:17 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-745132a5-8d29-41c3-b04a-aa28834dc04f tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34b83ea6-ac75-48ad-b452-0e74151e1e1c" status: 200 len: 1459 microversion: 2.1 time: 0.270339 Apr 14 17:29:17 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 334/991] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:29:16 2023] GET /compute/v2.1/servers/34b83ea6-ac75-48ad-b452-0e74151e1e1c => generated 1459 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:29:17 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-3e5ec978-4459-4f1d-b8f9-d13a70036a03 req-853f0064-84cc-4702-b119-0ae3a270aac8 service nova] Creating event network-vif-unplugged:1073478a-c9c5-4548-8276-ba9edb79833e for instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c on user Apr 14 17:29:17 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-3e5ec978-4459-4f1d-b8f9-d13a70036a03 req-853f0064-84cc-4702-b119-0ae3a270aac8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031954 Apr 14 17:29:17 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 329/992] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:29:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:29:18 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-bf20c82a-2edb-4c56-a1b0-6c4fd837ee22 req-eaf5ed4e-dd08-49fc-9913-7c9d851a4ccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b83ea6-ac75-48ad-b452-0e74151e1e1c", "name": "network-vif-deleted", "tag": "1073478a-c9c5-4548-8276-ba9edb79833e"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:29:18 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-bf20c82a-2edb-4c56-a1b0-6c4fd837ee22 req-eaf5ed4e-dd08-49fc-9913-7c9d851a4ccd service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:29:18 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-bf20c82a-2edb-4c56-a1b0-6c4fd837ee22 req-eaf5ed4e-dd08-49fc-9913-7c9d851a4ccd service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:29:18 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-bf20c82a-2edb-4c56-a1b0-6c4fd837ee22 req-eaf5ed4e-dd08-49fc-9913-7c9d851a4ccd service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:29:18 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-bf20c82a-2edb-4c56-a1b0-6c4fd837ee22 req-eaf5ed4e-dd08-49fc-9913-7c9d851a4ccd service nova] Creating event network-vif-deleted:1073478a-c9c5-4548-8276-ba9edb79833e for instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c on user Apr 14 17:29:18 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-bf20c82a-2edb-4c56-a1b0-6c4fd837ee22 req-eaf5ed4e-dd08-49fc-9913-7c9d851a4ccd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030893 Apr 14 17:29:18 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 330/993] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:29:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:29:19 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b83ea6-ac75-48ad-b452-0e74151e1e1c", "name": "network-vif-plugged", "status": "completed", "tag": "1073478a-c9c5-4548-8276-ba9edb79833e"}, {"server_uuid": "34b83ea6-ac75-48ad-b452-0e74151e1e1c", "name": "network-vif-plugged", "status": "completed", "tag": "1073478a-c9c5-4548-8276-ba9edb79833e"}, {"server_uuid": "34b83ea6-ac75-48ad-b452-0e74151e1e1c", "name": "network-vif-plugged", "status": "completed", "tag": "1073478a-c9c5-4548-8276-ba9edb79833e"}, {"server_uuid": "34b83ea6-ac75-48ad-b452-0e74151e1e1c", "name": "network-vif-unplugged", "status": "completed", "tag": "1073478a-c9c5-4548-8276-ba9edb79833e"}, {"server_uuid": "34b83ea6-ac75-48ad-b452-0e74151e1e1c", "name": "network-vif-plugged", "status": "completed", "tag": "1073478a-c9c5-4548-8276-ba9edb79833e"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:29:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:29:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:29:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:29:19 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Creating event network-vif-plugged:1073478a-c9c5-4548-8276-ba9edb79833e for instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c on user Apr 14 17:29:19 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Creating event network-vif-plugged:1073478a-c9c5-4548-8276-ba9edb79833e for instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c on user Apr 14 17:29:19 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Creating event network-vif-plugged:1073478a-c9c5-4548-8276-ba9edb79833e for instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c on user Apr 14 17:29:19 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Creating event network-vif-unplugged:1073478a-c9c5-4548-8276-ba9edb79833e for instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c on user Apr 14 17:29:19 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] Creating event network-vif-plugged:1073478a-c9c5-4548-8276-ba9edb79833e for instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c on user Apr 14 17:29:19 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-c8f200f9-5585-4dc6-9001-93ce6ed37fa1 req-71797705-e724-43a3-9e6a-5321a5a7bb70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.052461 Apr 14 17:29:19 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 335/994] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:29:19 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:29:46 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:29:46 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=8 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:29:46 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-67e2c0f9-29f3-440d-ab2b-9a56944dd00b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:29:46 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-67e2c0f9-29f3-440d-ab2b-9a56944dd00b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:29:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-67e2c0f9-29f3-440d-ab2b-9a56944dd00b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:29:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-67e2c0f9-29f3-440d-ab2b-9a56944dd00b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:29:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-67e2c0f9-29f3-440d-ab2b-9a56944dd00b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:29:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-67e2c0f9-29f3-440d-ab2b-9a56944dd00b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:29:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-67e2c0f9-29f3-440d-ab2b-9a56944dd00b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:29:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-67e2c0f9-29f3-440d-ab2b-9a56944dd00b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:29:46 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-67e2c0f9-29f3-440d-ab2b-9a56944dd00b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554e014a05a40c4bd070b4494314e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f9e856f81453b80189e456a2269fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:29:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-67e2c0f9-29f3-440d-ab2b-9a56944dd00b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29e0fe26-16f6-47b3-858b-37ff677de04f" status: 200 len: 1495 microversion: 2.1 time: 0.295987 Apr 14 17:29:46 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 330/995] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:29:46 2023] GET /compute/v2.1/servers/29e0fe26-16f6-47b3-858b-37ff677de04f => generated 1495 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:30:07 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:30:07 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:30:07 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-27dc61a4-bda5-4c24-888f-8cc26b205319 tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:30:07 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-27dc61a4-bda5-4c24-888f-8cc26b205319 tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] [instance: 34b83ea6-ac75-48ad-b452-0e74151e1e1c] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:30:07 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-27dc61a4-bda5-4c24-888f-8cc26b205319 tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:30:07 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-27dc61a4-bda5-4c24-888f-8cc26b205319 tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:30:07 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-27dc61a4-bda5-4c24-888f-8cc26b205319 tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:30:07 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-27dc61a4-bda5-4c24-888f-8cc26b205319 tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:30:07 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-27dc61a4-bda5-4c24-888f-8cc26b205319 tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:30:07 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-27dc61a4-bda5-4c24-888f-8cc26b205319 tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:30:07 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-27dc61a4-bda5-4c24-888f-8cc26b205319 tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] HTTP exception thrown: Instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c could not be found. Apr 14 17:30:07 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-27dc61a4-bda5-4c24-888f-8cc26b205319 tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Request method failure captured: Apr 14 17:30:07 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/34b83ea6-ac75-48ad-b452-0e74151e1e1c HTTP/1.1 Apr 14 17:30:07 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:30:07 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:30:07 user devstack@n-api.service[61934]: Connection: close Apr 14 17:30:07 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:30:07 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:30:07 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:30:07 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:30:07 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:30:07 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYz6iaAyLrZu1TzRyGDx_zOv2cghwLH8qIeSoG7fTKX_EG7CWivrgWrcJx7Coiepk26HmNUAJORyR5hhGdvW7jffSlEbtoP0MhImb0IKHa-PiSObcsbIDVAMHNbszHXPfglFE-fw76_dY-I-KMLtGjEM5UWmXdGDREwC41D7Xej8p3U Apr 14 17:30:07 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:30:07 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:30:07 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:30:07 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:30:07 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:30:07 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:30:07 user devstack@n-api.service[61934]: X-Project-Id: a442e486d0ac4ac8ad8205e16f9df504 Apr 14 17:30:07 user devstack@n-api.service[61934]: X-Project-Name: tempest-VolumesNegativeTest-1802972620 Apr 14 17:30:07 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:30:07 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:30:07 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a442e486d0ac4ac8ad8205e16f9df504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a442e486d0ac4ac8ad8205e16f9df504"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a442e486d0ac4ac8ad8205e16f9df504"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:30:07 user devstack@n-api.service[61934]: X-Tenant: tempest-VolumesNegativeTest-1802972620 Apr 14 17:30:07 user devstack@n-api.service[61934]: X-Tenant-Id: a442e486d0ac4ac8ad8205e16f9df504 Apr 14 17:30:07 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-VolumesNegativeTest-1802972620 Apr 14 17:30:07 user devstack@n-api.service[61934]: X-User: tempest-VolumesNegativeTest-1802972620-project-member Apr 14 17:30:07 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:30:07 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:30:07 user devstack@n-api.service[61934]: X-User-Id: 6e9c6562cb6341e1b4eeebbe95fcb981 Apr 14 17:30:07 user devstack@n-api.service[61934]: X-User-Name: tempest-VolumesNegativeTest-1802972620-project-member Apr 14 17:30:07 user devstack@n-api.service[61934]: method: > Apr 14 17:30:07 user devstack@n-api.service[61934]: exception: Instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c could not be found. Apr 14 17:30:07 user devstack@n-api.service[61934]: action_args: {'id': '34b83ea6-ac75-48ad-b452-0e74151e1e1c'} Apr 14 17:30:07 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c could not be found. Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c could not be found. Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c could not be found. Apr 14 17:30:07 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:30:07 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-27dc61a4-bda5-4c24-888f-8cc26b205319 tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] Returning 404 to user: Instance 34b83ea6-ac75-48ad-b452-0e74151e1e1c could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:30:07 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-27dc61a4-bda5-4c24-888f-8cc26b205319 tempest-VolumesNegativeTest-1802972620 tempest-VolumesNegativeTest-1802972620-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34b83ea6-ac75-48ad-b452-0e74151e1e1c" status: 404 len: 111 microversion: 2.1 time: 0.041038 Apr 14 17:30:07 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 331/996] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:30:07 2023] GET /compute/v2.1/servers/34b83ea6-ac75-48ad-b452-0e74151e1e1c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:30:10 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:30:10 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=8 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:30:10 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-73e7f1a1-d83f-4440-b9d1-8280d86bbb69 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:30:10 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-73e7f1a1-d83f-4440-b9d1-8280d86bbb69 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:30:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-73e7f1a1-d83f-4440-b9d1-8280d86bbb69 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:30:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-73e7f1a1-d83f-4440-b9d1-8280d86bbb69 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:30:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-73e7f1a1-d83f-4440-b9d1-8280d86bbb69 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:30:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-73e7f1a1-d83f-4440-b9d1-8280d86bbb69 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:30:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-73e7f1a1-d83f-4440-b9d1-8280d86bbb69 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:30:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-73e7f1a1-d83f-4440-b9d1-8280d86bbb69 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:30:10 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-73e7f1a1-d83f-4440-b9d1-8280d86bbb69 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:30:10 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-73e7f1a1-d83f-4440-b9d1-8280d86bbb69 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752" status: 200 len: 1546 microversion: 2.1 time: 0.436712 Apr 14 17:30:10 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 336/997] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:30:10 2023] GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752 => generated 1546 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:30:10 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-bcede50f-456c-49a7-a913-9f6e50d42ce6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:30:10 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-bcede50f-456c-49a7-a913-9f6e50d42ce6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:30:10 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:30:10 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:30:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-bcede50f-456c-49a7-a913-9f6e50d42ce6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:30:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-bcede50f-456c-49a7-a913-9f6e50d42ce6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:30:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-bcede50f-456c-49a7-a913-9f6e50d42ce6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:30:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-bcede50f-456c-49a7-a913-9f6e50d42ce6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:30:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-bcede50f-456c-49a7-a913-9f6e50d42ce6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:30:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-bcede50f-456c-49a7-a913-9f6e50d42ce6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:30:10 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-bcede50f-456c-49a7-a913-9f6e50d42ce6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "POST /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752/action" status: 200 len: 28493 microversion: 2.1 time: 0.221850 Apr 14 17:30:10 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 331/998] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:30:10 2023] POST /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752/action => generated 28493 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 17:30:10 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-2fcdf545-f062-49b6-9af6-b0f49442da25 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:30:10 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-2fcdf545-f062-49b6-9af6-b0f49442da25 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:30:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2fcdf545-f062-49b6-9af6-b0f49442da25 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:30:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2fcdf545-f062-49b6-9af6-b0f49442da25 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:30:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2fcdf545-f062-49b6-9af6-b0f49442da25 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:30:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2fcdf545-f062-49b6-9af6-b0f49442da25 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:30:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2fcdf545-f062-49b6-9af6-b0f49442da25 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:30:10 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2fcdf545-f062-49b6-9af6-b0f49442da25 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:30:11 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-2fcdf545-f062-49b6-9af6-b0f49442da25 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:30:11 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-2fcdf545-f062-49b6-9af6-b0f49442da25 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" status: 200 len: 1538 microversion: 2.1 time: 0.501588 Apr 14 17:30:11 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 332/999] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:30:10 2023] GET /compute/v2.1/servers/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 => generated 1538 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:30:46 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ecf5830-3453-486f-a955-3097272aa198", "device": "/dev/vdb"}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:30:46 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:30:46 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:30:46 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:30:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:30:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:30:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:30:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:30:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:30:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:30:46 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-98d2fb0d-efad-4a97-b407-98350a17b10b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] 10.0.0.210 "POST /compute/v2.1/servers/29e0fe26-16f6-47b3-858b-37ff677de04f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314992 Apr 14 17:30:46 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 337/1000] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:30:46 2023] POST /compute/v2.1/servers/29e0fe26-16f6-47b3-858b-37ff677de04f/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:31:11 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:31:11 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:31:11 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:31:11 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:31:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:31:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:31:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:31:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:31:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:31:11 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:31:11 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Going to try to terminate instance {{(pid=61933) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:31:11 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-4d9ec8f0-12ec-45bb-b198-b677a345d19b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752" status: 204 len: 0 microversion: 2.1 time: 0.141025 Apr 14 17:31:11 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 332/1001] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:31:11 2023] DELETE /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:31:11 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:31:11 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=8 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:31:11 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-fdaad527-98fd-412a-b0d8-d419c70d02ae tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:31:11 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-fdaad527-98fd-412a-b0d8-d419c70d02ae tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:31:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fdaad527-98fd-412a-b0d8-d419c70d02ae tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:31:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fdaad527-98fd-412a-b0d8-d419c70d02ae tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:31:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fdaad527-98fd-412a-b0d8-d419c70d02ae tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:31:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fdaad527-98fd-412a-b0d8-d419c70d02ae tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:31:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fdaad527-98fd-412a-b0d8-d419c70d02ae tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:31:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-fdaad527-98fd-412a-b0d8-d419c70d02ae tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:31:11 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:31:11 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:31:11 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-fdaad527-98fd-412a-b0d8-d419c70d02ae tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:31:11 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-fdaad527-98fd-412a-b0d8-d419c70d02ae tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752" status: 200 len: 1552 microversion: 2.1 time: 0.357527 Apr 14 17:31:11 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 333/1002] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:31:11 2023] GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752 => generated 1552 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:31:12 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-c79a4005-3eb9-47ce-b398-6fafef521a51 req-c401a2d9-4278-4ba4-841f-66100d880f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66599df0-d961-404f-9573-fe0289019752", "name": "network-vif-unplugged", "status": "completed", "tag": "b85a290c-1e7e-4f74-8590-be96f453decf"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:31:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c79a4005-3eb9-47ce-b398-6fafef521a51 req-c401a2d9-4278-4ba4-841f-66100d880f32 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:31:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c79a4005-3eb9-47ce-b398-6fafef521a51 req-c401a2d9-4278-4ba4-841f-66100d880f32 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:31:12 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-c79a4005-3eb9-47ce-b398-6fafef521a51 req-c401a2d9-4278-4ba4-841f-66100d880f32 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:31:12 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-c79a4005-3eb9-47ce-b398-6fafef521a51 req-c401a2d9-4278-4ba4-841f-66100d880f32 service nova] Creating event network-vif-unplugged:b85a290c-1e7e-4f74-8590-be96f453decf for instance 66599df0-d961-404f-9573-fe0289019752 on user Apr 14 17:31:12 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-c79a4005-3eb9-47ce-b398-6fafef521a51 req-c401a2d9-4278-4ba4-841f-66100d880f32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.200342 Apr 14 17:31:12 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 338/1003] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:31:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:31:13 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:31:13 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:31:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:31:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:31:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:31:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:31:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:31:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:31:13 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-da42b470-9fa3-4700-bd87-0317e94d1974 req-a741c98c-708c-429b-8a13-51351b4efe11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66599df0-d961-404f-9573-fe0289019752", "name": "network-vif-deleted", "tag": "b85a290c-1e7e-4f74-8590-be96f453decf"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:31:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-da42b470-9fa3-4700-bd87-0317e94d1974 req-a741c98c-708c-429b-8a13-51351b4efe11 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:31:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-da42b470-9fa3-4700-bd87-0317e94d1974 req-a741c98c-708c-429b-8a13-51351b4efe11 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:31:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-da42b470-9fa3-4700-bd87-0317e94d1974 req-a741c98c-708c-429b-8a13-51351b4efe11 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:31:13 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-da42b470-9fa3-4700-bd87-0317e94d1974 req-a741c98c-708c-429b-8a13-51351b4efe11 service nova] Creating event network-vif-deleted:b85a290c-1e7e-4f74-8590-be96f453decf for instance 66599df0-d961-404f-9573-fe0289019752 on user Apr 14 17:31:13 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-da42b470-9fa3-4700-bd87-0317e94d1974 req-a741c98c-708c-429b-8a13-51351b4efe11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123463 Apr 14 17:31:13 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 333/1004] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:31:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:31:13 user devstack@n-api.service[61934]: DEBUG nova.objects.instance [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lazy-loading 'services' on Instance uuid 29e0fe26-16f6-47b3-858b-37ff677de04f {{(pid=61934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:31:14 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-f4c4e403-f109-4346-9dcf-2e3e15c2cfa0 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/29e0fe26-16f6-47b3-858b-37ff677de04f/os-volume_attachments/1ecf5830-3453-486f-a955-3097272aa198" status: 202 len: 0 microversion: 2.1 time: 0.168220 Apr 14 17:31:14 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 334/1005] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:31:13 2023] DELETE /compute/v2.1/servers/29e0fe26-16f6-47b3-858b-37ff677de04f/os-volume_attachments/1ecf5830-3453-486f-a955-3097272aa198 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:31:14 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:31:14 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:31:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:31:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:31:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:31:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:31:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:31:14 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:31:14 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-93ad107a-59dc-4ca2-b744-186d1e37c1ce req-ac0c463f-63a4-4303-a7ef-8ddef8481c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66599df0-d961-404f-9573-fe0289019752", "name": "network-vif-plugged", "status": "completed", "tag": "b85a290c-1e7e-4f74-8590-be96f453decf"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:31:14 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Going to try to terminate instance {{(pid=61935) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:31:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-93ad107a-59dc-4ca2-b744-186d1e37c1ce req-ac0c463f-63a4-4303-a7ef-8ddef8481c87 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:31:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-93ad107a-59dc-4ca2-b744-186d1e37c1ce req-ac0c463f-63a4-4303-a7ef-8ddef8481c87 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:31:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-93ad107a-59dc-4ca2-b744-186d1e37c1ce req-ac0c463f-63a4-4303-a7ef-8ddef8481c87 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:31:14 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-93ad107a-59dc-4ca2-b744-186d1e37c1ce req-ac0c463f-63a4-4303-a7ef-8ddef8481c87 service nova] Creating event network-vif-plugged:b85a290c-1e7e-4f74-8590-be96f453decf for instance 66599df0-d961-404f-9573-fe0289019752 on user Apr 14 17:31:14 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-93ad107a-59dc-4ca2-b744-186d1e37c1ce req-ac0c463f-63a4-4303-a7ef-8ddef8481c87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035092 Apr 14 17:31:14 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 334/1006] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:31:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:31:14 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-9fe3a31a-7280-4e87-9273-c215b3dc166c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/29e0fe26-16f6-47b3-858b-37ff677de04f" status: 204 len: 0 microversion: 2.1 time: 0.133198 Apr 14 17:31:14 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 339/1007] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:31:14 2023] DELETE /compute/v2.1/servers/29e0fe26-16f6-47b3-858b-37ff677de04f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:31:14 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-c90e6c96-e83e-4882-8f11-d8390ddcbe1d tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:31:14 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-c90e6c96-e83e-4882-8f11-d8390ddcbe1d tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:31:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c90e6c96-e83e-4882-8f11-d8390ddcbe1d tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:31:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c90e6c96-e83e-4882-8f11-d8390ddcbe1d tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:31:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c90e6c96-e83e-4882-8f11-d8390ddcbe1d tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:31:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c90e6c96-e83e-4882-8f11-d8390ddcbe1d tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:31:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c90e6c96-e83e-4882-8f11-d8390ddcbe1d tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:31:14 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c90e6c96-e83e-4882-8f11-d8390ddcbe1d tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:31:14 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-c90e6c96-e83e-4882-8f11-d8390ddcbe1d tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554e014a05a40c4bd070b4494314e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f9e856f81453b80189e456a2269fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:31:14 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-c90e6c96-e83e-4882-8f11-d8390ddcbe1d tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29e0fe26-16f6-47b3-858b-37ff677de04f" status: 200 len: 1547 microversion: 2.1 time: 0.220496 Apr 14 17:31:14 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 335/1008] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:31:14 2023] GET /compute/v2.1/servers/29e0fe26-16f6-47b3-858b-37ff677de04f => generated 1547 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:31:16 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-6d22d36e-2fa8-4e3b-90fc-4bf9ce09e436 req-210f2e4d-d371-42f3-9724-b3c133950c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e0fe26-16f6-47b3-858b-37ff677de04f", "name": "network-vif-unplugged", "status": "completed", "tag": "500493ce-d3d4-47c3-99dc-06c6fabf828c"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:31:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-6d22d36e-2fa8-4e3b-90fc-4bf9ce09e436 req-210f2e4d-d371-42f3-9724-b3c133950c98 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:31:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-6d22d36e-2fa8-4e3b-90fc-4bf9ce09e436 req-210f2e4d-d371-42f3-9724-b3c133950c98 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:31:16 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-6d22d36e-2fa8-4e3b-90fc-4bf9ce09e436 req-210f2e4d-d371-42f3-9724-b3c133950c98 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:31:16 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-6d22d36e-2fa8-4e3b-90fc-4bf9ce09e436 req-210f2e4d-d371-42f3-9724-b3c133950c98 service nova] Creating event network-vif-unplugged:500493ce-d3d4-47c3-99dc-06c6fabf828c for instance 29e0fe26-16f6-47b3-858b-37ff677de04f on user Apr 14 17:31:16 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-6d22d36e-2fa8-4e3b-90fc-4bf9ce09e436 req-210f2e4d-d371-42f3-9724-b3c133950c98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031180 Apr 14 17:31:16 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 335/1009] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:31:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:31:17 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-91bb9be6-122d-417c-b2bf-8d9bb34b716e req-82ace9cb-95fa-4c01-874e-ee08b3ec6f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e0fe26-16f6-47b3-858b-37ff677de04f", "name": "network-vif-deleted", "tag": "500493ce-d3d4-47c3-99dc-06c6fabf828c"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:31:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-91bb9be6-122d-417c-b2bf-8d9bb34b716e req-82ace9cb-95fa-4c01-874e-ee08b3ec6f07 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:31:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-91bb9be6-122d-417c-b2bf-8d9bb34b716e req-82ace9cb-95fa-4c01-874e-ee08b3ec6f07 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:31:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-91bb9be6-122d-417c-b2bf-8d9bb34b716e req-82ace9cb-95fa-4c01-874e-ee08b3ec6f07 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:31:17 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-91bb9be6-122d-417c-b2bf-8d9bb34b716e req-82ace9cb-95fa-4c01-874e-ee08b3ec6f07 service nova] Creating event network-vif-deleted:500493ce-d3d4-47c3-99dc-06c6fabf828c for instance 29e0fe26-16f6-47b3-858b-37ff677de04f on user Apr 14 17:31:17 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-91bb9be6-122d-417c-b2bf-8d9bb34b716e req-82ace9cb-95fa-4c01-874e-ee08b3ec6f07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037393 Apr 14 17:31:17 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 340/1010] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:31:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:31:18 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-4728b964-e306-4a2a-8d98-5a73d0feea98 req-fa4b5daf-8ce2-4aa2-a1fa-ddd8bd63802b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e0fe26-16f6-47b3-858b-37ff677de04f", "name": "network-vif-plugged", "status": "completed", "tag": "500493ce-d3d4-47c3-99dc-06c6fabf828c"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:31:18 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-4728b964-e306-4a2a-8d98-5a73d0feea98 req-fa4b5daf-8ce2-4aa2-a1fa-ddd8bd63802b service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:31:18 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-4728b964-e306-4a2a-8d98-5a73d0feea98 req-fa4b5daf-8ce2-4aa2-a1fa-ddd8bd63802b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:31:18 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-4728b964-e306-4a2a-8d98-5a73d0feea98 req-fa4b5daf-8ce2-4aa2-a1fa-ddd8bd63802b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:31:18 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-4728b964-e306-4a2a-8d98-5a73d0feea98 req-fa4b5daf-8ce2-4aa2-a1fa-ddd8bd63802b service nova] Creating event network-vif-plugged:500493ce-d3d4-47c3-99dc-06c6fabf828c for instance 29e0fe26-16f6-47b3-858b-37ff677de04f on user Apr 14 17:31:18 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-4728b964-e306-4a2a-8d98-5a73d0feea98 req-fa4b5daf-8ce2-4aa2-a1fa-ddd8bd63802b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028837 Apr 14 17:31:18 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 336/1011] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:31:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:32:01 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:01 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-03895683-a593-482f-b4ca-d312786b7a49 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:32:01 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-03895683-a593-482f-b4ca-d312786b7a49 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:32:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-03895683-a593-482f-b4ca-d312786b7a49 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-03895683-a593-482f-b4ca-d312786b7a49 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-03895683-a593-482f-b4ca-d312786b7a49 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-03895683-a593-482f-b4ca-d312786b7a49 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-03895683-a593-482f-b4ca-d312786b7a49 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-03895683-a593-482f-b4ca-d312786b7a49 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:01 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-03895683-a593-482f-b4ca-d312786b7a49 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] HTTP exception thrown: Instance 66599df0-d961-404f-9573-fe0289019752 could not be found. Apr 14 17:32:02 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-03895683-a593-482f-b4ca-d312786b7a49 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Request method failure captured: Apr 14 17:32:02 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752 HTTP/1.1 Apr 14 17:32:02 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:32:02 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:32:02 user devstack@n-api.service[61933]: Connection: close Apr 14 17:32:02 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:32:02 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:32:02 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:32:02 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:32:02 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:32:02 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYh8HXXsf4bGlYrF_fOxQUmdFUk7ZjLLaQJs1zhxzjKy7c02nJ0ir8GYyoaprYCg0-4meGkGc2Z-BXH5-OvDeF0zr4fMdtzNd3C0ulgEACJz9sX5KqJt6iV8Bmpo3VUcdYwHyEQnBhpBhEqdSs6U3O3UogQINVr4C9pTqKOyF0aPHhM Apr 14 17:32:02 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:32:02 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:32:02 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:32:02 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:32:02 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:32:02 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:32:02 user devstack@n-api.service[61933]: X-Project-Id: 978cd1b4b6434b298731b01dac02591c Apr 14 17:32:02 user devstack@n-api.service[61933]: X-Project-Name: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:32:02 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:32:02 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:32:02 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:32:02 user devstack@n-api.service[61933]: X-Tenant: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:32:02 user devstack@n-api.service[61933]: X-Tenant-Id: 978cd1b4b6434b298731b01dac02591c Apr 14 17:32:02 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:32:02 user devstack@n-api.service[61933]: X-User: tempest-ServerActionsTestJSON-2079488933-project-member Apr 14 17:32:02 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:32:02 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:32:02 user devstack@n-api.service[61933]: X-User-Id: a22398c18fcc48aca2f0f9691f1c1143 Apr 14 17:32:02 user devstack@n-api.service[61933]: X-User-Name: tempest-ServerActionsTestJSON-2079488933-project-member Apr 14 17:32:02 user devstack@n-api.service[61933]: method: > Apr 14 17:32:02 user devstack@n-api.service[61933]: exception: Instance 66599df0-d961-404f-9573-fe0289019752 could not be found. Apr 14 17:32:02 user devstack@n-api.service[61933]: action_args: {'id': '66599df0-d961-404f-9573-fe0289019752'} Apr 14 17:32:02 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66599df0-d961-404f-9573-fe0289019752 could not be found. Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66599df0-d961-404f-9573-fe0289019752 could not be found. Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66599df0-d961-404f-9573-fe0289019752 could not be found. Apr 14 17:32:02 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:32:02 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-03895683-a593-482f-b4ca-d312786b7a49 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Returning 404 to user: Instance 66599df0-d961-404f-9573-fe0289019752 could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:32:02 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-03895683-a593-482f-b4ca-d312786b7a49 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752" status: 404 len: 111 microversion: 2.1 time: 0.044712 Apr 14 17:32:02 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 336/1012] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:32:01 2023] GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-49981a85-36f7-4702-8851-bd1dddd7bb77 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-49981a85-36f7-4702-8851-bd1dddd7bb77 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-49981a85-36f7-4702-8851-bd1dddd7bb77 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-49981a85-36f7-4702-8851-bd1dddd7bb77 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-49981a85-36f7-4702-8851-bd1dddd7bb77 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-49981a85-36f7-4702-8851-bd1dddd7bb77 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-49981a85-36f7-4702-8851-bd1dddd7bb77 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-49981a85-36f7-4702-8851-bd1dddd7bb77 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-49981a85-36f7-4702-8851-bd1dddd7bb77 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] HTTP exception thrown: Instance 66599df0-d961-404f-9573-fe0289019752 could not be found. Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-49981a85-36f7-4702-8851-bd1dddd7bb77 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Request method failure captured: Apr 14 17:32:02 user devstack@n-api.service[61935]: request: DELETE /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752 HTTP/1.1 Apr 14 17:32:02 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:32:02 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:32:02 user devstack@n-api.service[61935]: Connection: close Apr 14 17:32:02 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:32:02 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:32:02 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:32:02 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:32:02 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:32:02 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYh8HXXsf4bGlYrF_fOxQUmdFUk7ZjLLaQJs1zhxzjKy7c02nJ0ir8GYyoaprYCg0-4meGkGc2Z-BXH5-OvDeF0zr4fMdtzNd3C0ulgEACJz9sX5KqJt6iV8Bmpo3VUcdYwHyEQnBhpBhEqdSs6U3O3UogQINVr4C9pTqKOyF0aPHhM Apr 14 17:32:02 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:32:02 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:32:02 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:32:02 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:32:02 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:32:02 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:32:02 user devstack@n-api.service[61935]: X-Project-Id: 978cd1b4b6434b298731b01dac02591c Apr 14 17:32:02 user devstack@n-api.service[61935]: X-Project-Name: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:32:02 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:32:02 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:32:02 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:32:02 user devstack@n-api.service[61935]: X-Tenant: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:32:02 user devstack@n-api.service[61935]: X-Tenant-Id: 978cd1b4b6434b298731b01dac02591c Apr 14 17:32:02 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:32:02 user devstack@n-api.service[61935]: X-User: tempest-ServerActionsTestJSON-2079488933-project-member Apr 14 17:32:02 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:32:02 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:32:02 user devstack@n-api.service[61935]: X-User-Id: a22398c18fcc48aca2f0f9691f1c1143 Apr 14 17:32:02 user devstack@n-api.service[61935]: X-User-Name: tempest-ServerActionsTestJSON-2079488933-project-member Apr 14 17:32:02 user devstack@n-api.service[61935]: method: > Apr 14 17:32:02 user devstack@n-api.service[61935]: exception: Instance 66599df0-d961-404f-9573-fe0289019752 could not be found. Apr 14 17:32:02 user devstack@n-api.service[61935]: action_args: {'id': '66599df0-d961-404f-9573-fe0289019752'} Apr 14 17:32:02 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66599df0-d961-404f-9573-fe0289019752 could not be found. Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66599df0-d961-404f-9573-fe0289019752 could not be found. Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66599df0-d961-404f-9573-fe0289019752 could not be found. Apr 14 17:32:02 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-49981a85-36f7-4702-8851-bd1dddd7bb77 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Returning 404 to user: Instance 66599df0-d961-404f-9573-fe0289019752 could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:32:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-49981a85-36f7-4702-8851-bd1dddd7bb77 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752" status: 404 len: 111 microversion: 2.1 time: 0.036904 Apr 14 17:32:02 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 341/1013] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:32:02 2023] DELETE /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:32:02 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=8 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:02 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:02 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-4ec4a7a5-199b-4076-8bd7-7df6b9b21d8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:32:02 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-4ec4a7a5-199b-4076-8bd7-7df6b9b21d8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 66599df0-d961-404f-9573-fe0289019752] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:32:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4ec4a7a5-199b-4076-8bd7-7df6b9b21d8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4ec4a7a5-199b-4076-8bd7-7df6b9b21d8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4ec4a7a5-199b-4076-8bd7-7df6b9b21d8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4ec4a7a5-199b-4076-8bd7-7df6b9b21d8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4ec4a7a5-199b-4076-8bd7-7df6b9b21d8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4ec4a7a5-199b-4076-8bd7-7df6b9b21d8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:02 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-4ec4a7a5-199b-4076-8bd7-7df6b9b21d8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] HTTP exception thrown: Instance 66599df0-d961-404f-9573-fe0289019752 could not be found. Apr 14 17:32:02 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-4ec4a7a5-199b-4076-8bd7-7df6b9b21d8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Request method failure captured: Apr 14 17:32:02 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752 HTTP/1.1 Apr 14 17:32:02 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:32:02 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:32:02 user devstack@n-api.service[61934]: Connection: close Apr 14 17:32:02 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:32:02 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:32:02 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:32:02 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:32:02 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:32:02 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYh8HXXsf4bGlYrF_fOxQUmdFUk7ZjLLaQJs1zhxzjKy7c02nJ0ir8GYyoaprYCg0-4meGkGc2Z-BXH5-OvDeF0zr4fMdtzNd3C0ulgEACJz9sX5KqJt6iV8Bmpo3VUcdYwHyEQnBhpBhEqdSs6U3O3UogQINVr4C9pTqKOyF0aPHhM Apr 14 17:32:02 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:32:02 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:32:02 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:32:02 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:32:02 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:32:02 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:32:02 user devstack@n-api.service[61934]: X-Project-Id: 978cd1b4b6434b298731b01dac02591c Apr 14 17:32:02 user devstack@n-api.service[61934]: X-Project-Name: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:32:02 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:32:02 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:32:02 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:32:02 user devstack@n-api.service[61934]: X-Tenant: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:32:02 user devstack@n-api.service[61934]: X-Tenant-Id: 978cd1b4b6434b298731b01dac02591c Apr 14 17:32:02 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:32:02 user devstack@n-api.service[61934]: X-User: tempest-ServerActionsTestJSON-2079488933-project-member Apr 14 17:32:02 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:32:02 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:32:02 user devstack@n-api.service[61934]: X-User-Id: a22398c18fcc48aca2f0f9691f1c1143 Apr 14 17:32:02 user devstack@n-api.service[61934]: X-User-Name: tempest-ServerActionsTestJSON-2079488933-project-member Apr 14 17:32:02 user devstack@n-api.service[61934]: method: > Apr 14 17:32:02 user devstack@n-api.service[61934]: exception: Instance 66599df0-d961-404f-9573-fe0289019752 could not be found. Apr 14 17:32:02 user devstack@n-api.service[61934]: action_args: {'id': '66599df0-d961-404f-9573-fe0289019752'} Apr 14 17:32:02 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66599df0-d961-404f-9573-fe0289019752 could not be found. Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66599df0-d961-404f-9573-fe0289019752 could not be found. Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66599df0-d961-404f-9573-fe0289019752 could not be found. Apr 14 17:32:02 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:32:02 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-4ec4a7a5-199b-4076-8bd7-7df6b9b21d8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Returning 404 to user: Instance 66599df0-d961-404f-9573-fe0289019752 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:32:02 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-4ec4a7a5-199b-4076-8bd7-7df6b9b21d8a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752" status: 404 len: 111 microversion: 2.1 time: 0.041691 Apr 14 17:32:02 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 337/1014] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:32:02 2023] GET /compute/v2.1/servers/66599df0-d961-404f-9573-fe0289019752 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:32:02 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:32:02 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:32:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:02 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Going to try to terminate instance {{(pid=61933) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:32:02 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-6f938c89-52e8-4e01-8b66-3a701d1f11d6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" status: 204 len: 0 microversion: 2.1 time: 0.273957 Apr 14 17:32:02 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 337/1015] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:32:02 2023] DELETE /compute/v2.1/servers/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a757ff33-6fee-46e7-bd94-4fb015e78a6a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-a757ff33-6fee-46e7-bd94-4fb015e78a6a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a757ff33-6fee-46e7-bd94-4fb015e78a6a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a757ff33-6fee-46e7-bd94-4fb015e78a6a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a757ff33-6fee-46e7-bd94-4fb015e78a6a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a757ff33-6fee-46e7-bd94-4fb015e78a6a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a757ff33-6fee-46e7-bd94-4fb015e78a6a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a757ff33-6fee-46e7-bd94-4fb015e78a6a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:02 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-ffdc26a0-13ec-4954-aa7c-99af5091664d req-374cab89-5edb-46ad-b194-e2f2142fcd27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88", "name": "network-vif-unplugged", "status": "completed", "tag": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:32:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ffdc26a0-13ec-4954-aa7c-99af5091664d req-374cab89-5edb-46ad-b194-e2f2142fcd27 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ffdc26a0-13ec-4954-aa7c-99af5091664d req-374cab89-5edb-46ad-b194-e2f2142fcd27 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ffdc26a0-13ec-4954-aa7c-99af5091664d req-374cab89-5edb-46ad-b194-e2f2142fcd27 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:02 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-ffdc26a0-13ec-4954-aa7c-99af5091664d req-374cab89-5edb-46ad-b194-e2f2142fcd27 service nova] Creating event network-vif-unplugged:ff6f2e44-8051-46b5-9b63-46b5fcc6db6a for instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 on user Apr 14 17:32:02 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-ffdc26a0-13ec-4954-aa7c-99af5091664d req-374cab89-5edb-46ad-b194-e2f2142fcd27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031022 Apr 14 17:32:02 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 338/1016] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:32:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:32:02 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-a757ff33-6fee-46e7-bd94-4fb015e78a6a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22398c18fcc48aca2f0f9691f1c1143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978cd1b4b6434b298731b01dac02591c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:32:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-a757ff33-6fee-46e7-bd94-4fb015e78a6a tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" status: 200 len: 1544 microversion: 2.1 time: 0.467614 Apr 14 17:32:02 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 342/1017] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:32:02 2023] GET /compute/v2.1/servers/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 => generated 1544 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:32:03 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-fbc7c15f-9610-4370-9a6c-a3934e3c7528 req-c3e65a8e-4274-4437-bca5-9fe2a04f25d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88", "name": "network-vif-deleted", "tag": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:32:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-fbc7c15f-9610-4370-9a6c-a3934e3c7528 req-c3e65a8e-4274-4437-bca5-9fe2a04f25d1 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-fbc7c15f-9610-4370-9a6c-a3934e3c7528 req-c3e65a8e-4274-4437-bca5-9fe2a04f25d1 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:03 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-fbc7c15f-9610-4370-9a6c-a3934e3c7528 req-c3e65a8e-4274-4437-bca5-9fe2a04f25d1 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:03 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-fbc7c15f-9610-4370-9a6c-a3934e3c7528 req-c3e65a8e-4274-4437-bca5-9fe2a04f25d1 service nova] Creating event network-vif-deleted:ff6f2e44-8051-46b5-9b63-46b5fcc6db6a for instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 on user Apr 14 17:32:03 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-fbc7c15f-9610-4370-9a6c-a3934e3c7528 req-c3e65a8e-4274-4437-bca5-9fe2a04f25d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061289 Apr 14 17:32:03 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 338/1018] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:32:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:32:04 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-e0446eb1-5077-4053-a2fc-2b262dd65c69 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:32:04 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-e0446eb1-5077-4053-a2fc-2b262dd65c69 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: 29e0fe26-16f6-47b3-858b-37ff677de04f] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:32:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e0446eb1-5077-4053-a2fc-2b262dd65c69 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e0446eb1-5077-4053-a2fc-2b262dd65c69 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e0446eb1-5077-4053-a2fc-2b262dd65c69 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e0446eb1-5077-4053-a2fc-2b262dd65c69 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e0446eb1-5077-4053-a2fc-2b262dd65c69 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e0446eb1-5077-4053-a2fc-2b262dd65c69 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:04 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-e0446eb1-5077-4053-a2fc-2b262dd65c69 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] HTTP exception thrown: Instance 29e0fe26-16f6-47b3-858b-37ff677de04f could not be found. Apr 14 17:32:04 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-e0446eb1-5077-4053-a2fc-2b262dd65c69 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Request method failure captured: Apr 14 17:32:04 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/29e0fe26-16f6-47b3-858b-37ff677de04f HTTP/1.1 Apr 14 17:32:04 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:32:04 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:32:04 user devstack@n-api.service[61934]: Connection: close Apr 14 17:32:04 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:32:04 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:32:04 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:32:04 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:32:04 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:32:04 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOY1RGB_qBcTds-YjtOt3lyYJamcWfuoRcExUOLuV-xr3mDDQaeFPGulwqQRKU_H8RFawcqs9TALQmvmZgNkJr_0jROKjZeRSFVYhoqlXZFgTCzZk0etnssK9rspAkIHK8KsO3CzZlo8rAsVhOG-Eei7b2DLBwJzFdctRVBEKa-SldVA Apr 14 17:32:04 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:32:04 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:32:04 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:32:04 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:32:04 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:32:04 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:32:04 user devstack@n-api.service[61934]: X-Project-Id: 360f9e856f81453b80189e456a2269fe Apr 14 17:32:04 user devstack@n-api.service[61934]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1090163427 Apr 14 17:32:04 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:32:04 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:32:04 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/360f9e856f81453b80189e456a2269fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/360f9e856f81453b80189e456a2269fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/360f9e856f81453b80189e456a2269fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:32:04 user devstack@n-api.service[61934]: X-Tenant: tempest-VolumesSnapshotTestJSON-1090163427 Apr 14 17:32:04 user devstack@n-api.service[61934]: X-Tenant-Id: 360f9e856f81453b80189e456a2269fe Apr 14 17:32:04 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1090163427 Apr 14 17:32:04 user devstack@n-api.service[61934]: X-User: tempest-VolumesSnapshotTestJSON-1090163427-project-member Apr 14 17:32:04 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:32:04 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:32:04 user devstack@n-api.service[61934]: X-User-Id: f554e014a05a40c4bd070b4494314e33 Apr 14 17:32:04 user devstack@n-api.service[61934]: X-User-Name: tempest-VolumesSnapshotTestJSON-1090163427-project-member Apr 14 17:32:04 user devstack@n-api.service[61934]: method: > Apr 14 17:32:04 user devstack@n-api.service[61934]: exception: Instance 29e0fe26-16f6-47b3-858b-37ff677de04f could not be found. Apr 14 17:32:04 user devstack@n-api.service[61934]: action_args: {'id': '29e0fe26-16f6-47b3-858b-37ff677de04f'} Apr 14 17:32:04 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e0fe26-16f6-47b3-858b-37ff677de04f could not be found. Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e0fe26-16f6-47b3-858b-37ff677de04f could not be found. Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e0fe26-16f6-47b3-858b-37ff677de04f could not be found. Apr 14 17:32:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:32:04 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-e0446eb1-5077-4053-a2fc-2b262dd65c69 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Returning 404 to user: Instance 29e0fe26-16f6-47b3-858b-37ff677de04f could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:32:04 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-e0446eb1-5077-4053-a2fc-2b262dd65c69 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29e0fe26-16f6-47b3-858b-37ff677de04f" status: 404 len: 111 microversion: 2.1 time: 0.033009 Apr 14 17:32:04 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 339/1019] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:32:04 2023] GET /compute/v2.1/servers/29e0fe26-16f6-47b3-858b-37ff677de04f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:32:04 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-12af530f-4dd3-424e-b93e-e2e54cbe3b9c req-c217ded4-a478-493b-8c82-62047a533641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce9811b-8c03-4a32-bfb0-5c9bc5867e88", "name": "network-vif-plugged", "status": "completed", "tag": "ff6f2e44-8051-46b5-9b63-46b5fcc6db6a"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:32:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-12af530f-4dd3-424e-b93e-e2e54cbe3b9c req-c217ded4-a478-493b-8c82-62047a533641 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-12af530f-4dd3-424e-b93e-e2e54cbe3b9c req-c217ded4-a478-493b-8c82-62047a533641 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-12af530f-4dd3-424e-b93e-e2e54cbe3b9c req-c217ded4-a478-493b-8c82-62047a533641 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:04 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-12af530f-4dd3-424e-b93e-e2e54cbe3b9c req-c217ded4-a478-493b-8c82-62047a533641 service nova] Creating event network-vif-plugged:ff6f2e44-8051-46b5-9b63-46b5fcc6db6a for instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 on user Apr 14 17:32:04 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-12af530f-4dd3-424e-b93e-e2e54cbe3b9c req-c217ded4-a478-493b-8c82-62047a533641 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105327 Apr 14 17:32:04 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 343/1020] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:32:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:32:17 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:17 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:17 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1637085239", "imageRef": "b0124a46-3c94-42d9-9961-82730022fc5b", "flavorRef": "42", "networks": [{"uuid": "777a6d32-2983-4b6e-844a-655be73af980"}]}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:32:17 user devstack@n-api.service[61933]: DEBUG nova.network.neutron [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] validate_networks() for [('777a6d32-2983-4b6e-844a-655be73af980', None, None, None, None, None)] {{(pid=61933) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:32:18 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Flavor limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:32:18 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Image limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:32:18 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Flavor pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:32:18 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Image pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:32:18 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:32:18 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:18 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:18 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:18 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:18 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:18 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:18 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Getting quotas for project 360f9e856f81453b80189e456a2269fe. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:32:18 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Getting quotas for user f554e014a05a40c4bd070b4494314e33 and project 360f9e856f81453b80189e456a2269fe. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:32:18 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Going to run 1 instances... {{(pid=61933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:32:18 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0124a46-3c94-42d9-9961-82730022fc5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:32:18 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-93f68c10-91e0-411a-96d6-d92242f68ad4 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.690310 Apr 14 17:32:18 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 339/1021] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:32:17 2023] POST /compute/v2.1/servers => generated 378 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:32:18 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-3b74289e-2e94-45b2-8e89-ce5df87d6d1b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:32:18 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-3b74289e-2e94-45b2-8e89-ce5df87d6d1b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:32:18 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:18 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:18 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-3b74289e-2e94-45b2-8e89-ce5df87d6d1b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554e014a05a40c4bd070b4494314e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f9e856f81453b80189e456a2269fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:32:18 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-3b74289e-2e94-45b2-8e89-ce5df87d6d1b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49" status: 200 len: 1213 microversion: 2.1 time: 0.072988 Apr 14 17:32:18 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 340/1022] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:32:18 2023] GET /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:32:20 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:20 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=10 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:20 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-2a4a1119-963d-451d-94e7-af315bd0fc0e req-5adb04dc-3f00-402b-bf9c-d463476c1682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abe0d33a-5e2f-4b27-b79f-a1e934e7db49", "tag": "8099356e-819f-4d82-8d19-38637909cf0c"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:32:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2a4a1119-963d-451d-94e7-af315bd0fc0e req-5adb04dc-3f00-402b-bf9c-d463476c1682 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2a4a1119-963d-451d-94e7-af315bd0fc0e req-5adb04dc-3f00-402b-bf9c-d463476c1682 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-2a4a1119-963d-451d-94e7-af315bd0fc0e req-5adb04dc-3f00-402b-bf9c-d463476c1682 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:20 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-2a4a1119-963d-451d-94e7-af315bd0fc0e req-5adb04dc-3f00-402b-bf9c-d463476c1682 service nova] Creating event network-changed:8099356e-819f-4d82-8d19-38637909cf0c for instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 on user Apr 14 17:32:20 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-2a4a1119-963d-451d-94e7-af315bd0fc0e req-5adb04dc-3f00-402b-bf9c-d463476c1682 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035270 Apr 14 17:32:20 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 344/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:32:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:32:22 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-1ad45b03-6135-43a7-b1aa-553e14891131 req-2ab71dd4-aec1-4c1c-ab61-5be098627d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe0d33a-5e2f-4b27-b79f-a1e934e7db49", "name": "network-vif-plugged", "status": "completed", "tag": "8099356e-819f-4d82-8d19-38637909cf0c"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:32:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-1ad45b03-6135-43a7-b1aa-553e14891131 req-2ab71dd4-aec1-4c1c-ab61-5be098627d9e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-1ad45b03-6135-43a7-b1aa-553e14891131 req-2ab71dd4-aec1-4c1c-ab61-5be098627d9e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:22 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-1ad45b03-6135-43a7-b1aa-553e14891131 req-2ab71dd4-aec1-4c1c-ab61-5be098627d9e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:22 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-1ad45b03-6135-43a7-b1aa-553e14891131 req-2ab71dd4-aec1-4c1c-ab61-5be098627d9e service nova] Creating event network-vif-plugged:8099356e-819f-4d82-8d19-38637909cf0c for instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 on user Apr 14 17:32:22 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-1ad45b03-6135-43a7-b1aa-553e14891131 req-2ab71dd4-aec1-4c1c-ab61-5be098627d9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030220 Apr 14 17:32:22 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 340/1024] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:32:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:32:24 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-3caf7c55-6643-41c0-89f9-0fbbdf83aed4 req-cc9ea88c-58cc-475c-8880-a8878c1d576a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe0d33a-5e2f-4b27-b79f-a1e934e7db49", "name": "network-vif-plugged", "status": "completed", "tag": "8099356e-819f-4d82-8d19-38637909cf0c"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:32:24 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3caf7c55-6643-41c0-89f9-0fbbdf83aed4 req-cc9ea88c-58cc-475c-8880-a8878c1d576a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:24 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3caf7c55-6643-41c0-89f9-0fbbdf83aed4 req-cc9ea88c-58cc-475c-8880-a8878c1d576a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:24 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-3caf7c55-6643-41c0-89f9-0fbbdf83aed4 req-cc9ea88c-58cc-475c-8880-a8878c1d576a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:24 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-3caf7c55-6643-41c0-89f9-0fbbdf83aed4 req-cc9ea88c-58cc-475c-8880-a8878c1d576a service nova] Creating event network-vif-plugged:8099356e-819f-4d82-8d19-38637909cf0c for instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 on user Apr 14 17:32:24 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-3caf7c55-6643-41c0-89f9-0fbbdf83aed4 req-cc9ea88c-58cc-475c-8880-a8878c1d576a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028161 Apr 14 17:32:24 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 341/1025] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:32:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:32:52 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:52 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:52 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-13695db4-4268-4b21-a4e1-604104765ec7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:32:52 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-13695db4-4268-4b21-a4e1-604104765ec7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:32:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-13695db4-4268-4b21-a4e1-604104765ec7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-13695db4-4268-4b21-a4e1-604104765ec7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-13695db4-4268-4b21-a4e1-604104765ec7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-13695db4-4268-4b21-a4e1-604104765ec7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-13695db4-4268-4b21-a4e1-604104765ec7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:52 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-13695db4-4268-4b21-a4e1-604104765ec7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:52 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-13695db4-4268-4b21-a4e1-604104765ec7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] HTTP exception thrown: Instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 could not be found. Apr 14 17:32:52 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-13695db4-4268-4b21-a4e1-604104765ec7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Request method failure captured: Apr 14 17:32:52 user devstack@n-api.service[61935]: request: GET /compute/v2.1/servers/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 HTTP/1.1 Apr 14 17:32:52 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:32:52 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:32:52 user devstack@n-api.service[61935]: Connection: close Apr 14 17:32:52 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:32:52 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:32:52 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:32:52 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:32:52 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:32:52 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOYh8HXXsf4bGlYrF_fOxQUmdFUk7ZjLLaQJs1zhxzjKy7c02nJ0ir8GYyoaprYCg0-4meGkGc2Z-BXH5-OvDeF0zr4fMdtzNd3C0ulgEACJz9sX5KqJt6iV8Bmpo3VUcdYwHyEQnBhpBhEqdSs6U3O3UogQINVr4C9pTqKOyF0aPHhM Apr 14 17:32:52 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:32:52 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:32:52 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:32:52 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:32:52 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:32:52 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:32:52 user devstack@n-api.service[61935]: X-Project-Id: 978cd1b4b6434b298731b01dac02591c Apr 14 17:32:52 user devstack@n-api.service[61935]: X-Project-Name: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:32:52 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:32:52 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:32:52 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:32:52 user devstack@n-api.service[61935]: X-Tenant: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:32:52 user devstack@n-api.service[61935]: X-Tenant-Id: 978cd1b4b6434b298731b01dac02591c Apr 14 17:32:52 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:32:52 user devstack@n-api.service[61935]: X-User: tempest-ServerActionsTestJSON-2079488933-project-member Apr 14 17:32:52 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:32:52 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:32:52 user devstack@n-api.service[61935]: X-User-Id: a22398c18fcc48aca2f0f9691f1c1143 Apr 14 17:32:52 user devstack@n-api.service[61935]: X-User-Name: tempest-ServerActionsTestJSON-2079488933-project-member Apr 14 17:32:52 user devstack@n-api.service[61935]: method: > Apr 14 17:32:52 user devstack@n-api.service[61935]: exception: Instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 could not be found. Apr 14 17:32:52 user devstack@n-api.service[61935]: action_args: {'id': '4ce9811b-8c03-4a32-bfb0-5c9bc5867e88'} Apr 14 17:32:52 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 could not be found. Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 could not be found. Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 could not be found. Apr 14 17:32:52 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:32:52 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-13695db4-4268-4b21-a4e1-604104765ec7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Returning 404 to user: Instance 4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:32:52 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-13695db4-4268-4b21-a4e1-604104765ec7 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88" status: 404 len: 111 microversion: 2.1 time: 0.033994 Apr 14 17:32:52 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 345/1026] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:32:52 2023] GET /compute/v2.1/servers/4ce9811b-8c03-4a32-bfb0-5c9bc5867e88 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:32:59 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:59 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:59 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:59 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:59 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b710962c-d9b4-49cf-a449-0ce5fd2d5521 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:32:59 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-b710962c-d9b4-49cf-a449-0ce5fd2d5521 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:32:59 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b710962c-d9b4-49cf-a449-0ce5fd2d5521 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:59 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b710962c-d9b4-49cf-a449-0ce5fd2d5521 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:59 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b710962c-d9b4-49cf-a449-0ce5fd2d5521 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:59 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b710962c-d9b4-49cf-a449-0ce5fd2d5521 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:59 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b710962c-d9b4-49cf-a449-0ce5fd2d5521 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:59 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b710962c-d9b4-49cf-a449-0ce5fd2d5521 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:59 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-b710962c-d9b4-49cf-a449-0ce5fd2d5521 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] HTTP exception thrown: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:32:59 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b710962c-d9b4-49cf-a449-0ce5fd2d5521 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Request method failure captured: Apr 14 17:32:59 user devstack@n-api.service[61933]: request: DELETE /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 HTTP/1.1 Apr 14 17:32:59 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:32:59 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:32:59 user devstack@n-api.service[61933]: Connection: close Apr 14 17:32:59 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:32:59 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:32:59 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:32:59 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:32:59 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:32:59 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOYh8HXXsf4bGlYrF_fOxQUmdFUk7ZjLLaQJs1zhxzjKy7c02nJ0ir8GYyoaprYCg0-4meGkGc2Z-BXH5-OvDeF0zr4fMdtzNd3C0ulgEACJz9sX5KqJt6iV8Bmpo3VUcdYwHyEQnBhpBhEqdSs6U3O3UogQINVr4C9pTqKOyF0aPHhM Apr 14 17:32:59 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:32:59 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:32:59 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:32:59 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:32:59 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:32:59 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:32:59 user devstack@n-api.service[61933]: X-Project-Id: 978cd1b4b6434b298731b01dac02591c Apr 14 17:32:59 user devstack@n-api.service[61933]: X-Project-Name: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:32:59 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:32:59 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:32:59 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:32:59 user devstack@n-api.service[61933]: X-Tenant: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:32:59 user devstack@n-api.service[61933]: X-Tenant-Id: 978cd1b4b6434b298731b01dac02591c Apr 14 17:32:59 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:32:59 user devstack@n-api.service[61933]: X-User: tempest-ServerActionsTestJSON-2079488933-project-member Apr 14 17:32:59 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:32:59 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:32:59 user devstack@n-api.service[61933]: X-User-Id: a22398c18fcc48aca2f0f9691f1c1143 Apr 14 17:32:59 user devstack@n-api.service[61933]: X-User-Name: tempest-ServerActionsTestJSON-2079488933-project-member Apr 14 17:32:59 user devstack@n-api.service[61933]: method: > Apr 14 17:32:59 user devstack@n-api.service[61933]: exception: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:32:59 user devstack@n-api.service[61933]: action_args: {'id': '84c02556-abf7-4832-a1b2-a2c28a7f8e52'} Apr 14 17:32:59 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:32:59 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:32:59 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b710962c-d9b4-49cf-a449-0ce5fd2d5521 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Returning 404 to user: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:32:59 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-b710962c-d9b4-49cf-a449-0ce5fd2d5521 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 404 len: 111 microversion: 2.1 time: 0.051302 Apr 14 17:32:59 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 341/1027] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:32:59 2023] DELETE /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:32:59 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:59 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:59 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:32:59 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-f193e9ee-1d4e-476f-94c6-c57cf2a5f5f6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:32:59 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-f193e9ee-1d4e-476f-94c6-c57cf2a5f5f6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] [instance: 84c02556-abf7-4832-a1b2-a2c28a7f8e52] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:32:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f193e9ee-1d4e-476f-94c6-c57cf2a5f5f6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f193e9ee-1d4e-476f-94c6-c57cf2a5f5f6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f193e9ee-1d4e-476f-94c6-c57cf2a5f5f6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f193e9ee-1d4e-476f-94c6-c57cf2a5f5f6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:32:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f193e9ee-1d4e-476f-94c6-c57cf2a5f5f6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:32:59 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f193e9ee-1d4e-476f-94c6-c57cf2a5f5f6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:32:59 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-f193e9ee-1d4e-476f-94c6-c57cf2a5f5f6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] HTTP exception thrown: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:32:59 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-f193e9ee-1d4e-476f-94c6-c57cf2a5f5f6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Request method failure captured: Apr 14 17:32:59 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 HTTP/1.1 Apr 14 17:32:59 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:32:59 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:32:59 user devstack@n-api.service[61934]: Connection: close Apr 14 17:32:59 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:32:59 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:32:59 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:32:59 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:32:59 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:32:59 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOYh8HXXsf4bGlYrF_fOxQUmdFUk7ZjLLaQJs1zhxzjKy7c02nJ0ir8GYyoaprYCg0-4meGkGc2Z-BXH5-OvDeF0zr4fMdtzNd3C0ulgEACJz9sX5KqJt6iV8Bmpo3VUcdYwHyEQnBhpBhEqdSs6U3O3UogQINVr4C9pTqKOyF0aPHhM Apr 14 17:32:59 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:32:59 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:32:59 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:32:59 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:32:59 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:32:59 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:32:59 user devstack@n-api.service[61934]: X-Project-Id: 978cd1b4b6434b298731b01dac02591c Apr 14 17:32:59 user devstack@n-api.service[61934]: X-Project-Name: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:32:59 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:32:59 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:32:59 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/978cd1b4b6434b298731b01dac02591c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:32:59 user devstack@n-api.service[61934]: X-Tenant: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:32:59 user devstack@n-api.service[61934]: X-Tenant-Id: 978cd1b4b6434b298731b01dac02591c Apr 14 17:32:59 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079488933 Apr 14 17:32:59 user devstack@n-api.service[61934]: X-User: tempest-ServerActionsTestJSON-2079488933-project-member Apr 14 17:32:59 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:32:59 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:32:59 user devstack@n-api.service[61934]: X-User-Id: a22398c18fcc48aca2f0f9691f1c1143 Apr 14 17:32:59 user devstack@n-api.service[61934]: X-User-Name: tempest-ServerActionsTestJSON-2079488933-project-member Apr 14 17:32:59 user devstack@n-api.service[61934]: method: > Apr 14 17:32:59 user devstack@n-api.service[61934]: exception: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:32:59 user devstack@n-api.service[61934]: action_args: {'id': '84c02556-abf7-4832-a1b2-a2c28a7f8e52'} Apr 14 17:32:59 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. Apr 14 17:32:59 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:32:59 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-f193e9ee-1d4e-476f-94c6-c57cf2a5f5f6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Returning 404 to user: Instance 84c02556-abf7-4832-a1b2-a2c28a7f8e52 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:32:59 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-f193e9ee-1d4e-476f-94c6-c57cf2a5f5f6 tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52" status: 404 len: 111 microversion: 2.1 time: 0.042125 Apr 14 17:32:59 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 342/1028] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:32:59 2023] GET /compute/v2.1/servers/84c02556-abf7-4832-a1b2-a2c28a7f8e52 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:32:59 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-e7d532a6-f3be-48ad-8c5f-64acafa7cb4b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] Calling method '.version_select at 0x7fe19d3b2ef0>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:32:59 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-e7d532a6-f3be-48ad-8c5f-64acafa7cb4b tempest-ServerActionsTestJSON-2079488933 tempest-ServerActionsTestJSON-2079488933-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-310941958" status: 202 len: 0 microversion: 2.1 time: 0.024796 Apr 14 17:32:59 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 346/1029] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 17:32:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-310941958 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:33:04 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-0170fede-a118-4c38-8a79-4447d53a020e tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] Action: 'create', calling method: .version_select at 0x7fe19d07e0e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-399135948", "metadata": {"Type": "work"}}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:33:05 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-0170fede-a118-4c38-8a79-4447d53a020e tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.457432 Apr 14 17:33:05 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 342/1030] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 17:33:04 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 459 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 17:33:05 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-788f89a3-24bd-4707-a709-014e92bf4545 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] Calling method '.version_select at 0x7fe19d3ca050>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:33:05 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-788f89a3-24bd-4707-a709-014e92bf4545 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac" status: 200 len: 352 microversion: 2.1 time: 0.096535 Apr 14 17:33:05 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 343/1031] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:33:05 2023] GET /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:33:06 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:33:06 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-c95a9077-bc5f-421f-aa04-e3ed44539042 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] Calling method '.version_select at 0x7fe19d3d9c60>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:33:06 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-c95a9077-bc5f-421f-aa04-e3ed44539042 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac" status: 200 len: 352 microversion: 2.1 time: 0.051805 Apr 14 17:33:06 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 347/1032] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:33:06 2023] GET /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:33:07 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-dec8a94e-c616-4a7b-8c1e-006b5cca2043 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] Calling method '.version_select at 0x7fe19d2075b0>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:33:07 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-dec8a94e-c616-4a7b-8c1e-006b5cca2043 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac" status: 200 len: 353 microversion: 2.1 time: 0.059306 Apr 14 17:33:07 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 343/1033] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:33:07 2023] GET /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:33:07 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-735c638a-2073-4d3e-b501-3c118dc3fa7f tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] Calling method '.version_select at 0x7fe19d0f9c60>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:33:07 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-735c638a-2073-4d3e-b501-3c118dc3fa7f tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac" status: 200 len: 353 microversion: 2.1 time: 0.052214 Apr 14 17:33:07 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 344/1034] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:33:07 2023] GET /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:33:07 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-080c8db9-953f-4c8e-a66d-09451092b708 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] Calling method '.version_select at 0x7fe19d1cfe20>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:33:07 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-080c8db9-953f-4c8e-a66d-09451092b708 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac" status: 202 len: 0 microversion: 2.1 time: 0.065741 Apr 14 17:33:07 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 348/1035] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 17:33:07 2023] DELETE /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:33:07 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-3119dce3-bd30-4074-b447-e41afbf24fc5 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] Calling method '.version_select at 0x7fe19d43ec20>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:33:07 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-3119dce3-bd30-4074-b447-e41afbf24fc5 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac" status: 200 len: 352 microversion: 2.1 time: 0.050542 Apr 14 17:33:07 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 344/1036] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:33:07 2023] GET /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:33:08 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-4799bfc9-c608-485a-acb5-1a981cc4300c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:33:08 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-4799bfc9-c608-485a-acb5-1a981cc4300c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:33:08 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4799bfc9-c608-485a-acb5-1a981cc4300c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:33:08 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4799bfc9-c608-485a-acb5-1a981cc4300c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:33:08 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4799bfc9-c608-485a-acb5-1a981cc4300c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:33:08 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4799bfc9-c608-485a-acb5-1a981cc4300c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:33:08 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4799bfc9-c608-485a-acb5-1a981cc4300c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:33:08 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-4799bfc9-c608-485a-acb5-1a981cc4300c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:33:08 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-f58fb622-0b17-4fda-b219-1bfbf1646e53 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] Calling method '.version_select at 0x7fe19cfadc60>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:33:08 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-f58fb622-0b17-4fda-b219-1bfbf1646e53 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac" status: 200 len: 352 microversion: 2.1 time: 0.054161 Apr 14 17:33:08 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 349/1037] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:33:08 2023] GET /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:33:08 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-4799bfc9-c608-485a-acb5-1a981cc4300c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554e014a05a40c4bd070b4494314e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f9e856f81453b80189e456a2269fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:33:08 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-4799bfc9-c608-485a-acb5-1a981cc4300c tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49" status: 200 len: 1495 microversion: 2.1 time: 0.261186 Apr 14 17:33:08 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 345/1038] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:33:08 2023] GET /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49 => generated 1495 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:33:09 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:33:09 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:33:09 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-1426d171-902b-4dee-8fc4-dcfdf837a682 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] Calling method '.version_select at 0x7fe19d07f7f0>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:33:09 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-1426d171-902b-4dee-8fc4-dcfdf837a682 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac" status: 200 len: 352 microversion: 2.1 time: 0.054705 Apr 14 17:33:09 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 345/1039] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:33:09 2023] GET /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:33:10 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:33:10 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a0c29f1b-cac1-4284-a250-59b102718a71 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] Calling method '.version_select at 0x7fe19d22a9e0>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:33:10 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-a0c29f1b-cac1-4284-a250-59b102718a71 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] HTTP exception thrown: Volume 5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac could not be found. Apr 14 17:33:10 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a0c29f1b-cac1-4284-a250-59b102718a71 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] Request method failure captured: Apr 14 17:33:10 user devstack@n-api.service[61935]: request: GET /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac HTTP/1.1 Apr 14 17:33:10 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:33:10 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:33:10 user devstack@n-api.service[61935]: Connection: close Apr 14 17:33:10 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:33:10 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:33:10 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:33:10 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:33:10 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:33:10 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOY5QBL-mp7C-S37xHZKu3gAnIz8DwErKjRmSrybOLdIygQ0xGdS0jxzo8J8Rm_ZaN68EopQGn8VrIlW1xPM9V-xH3siLlisLtC6FnegmI48JTDP9jpGAv_tfCiU7XD6UUKqVLRux1WZIJttIIDo8u6ylkoM_MVImULfjneWkKZMTsFk Apr 14 17:33:10 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:33:10 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:33:10 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:33:10 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:33:10 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:33:10 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:33:10 user devstack@n-api.service[61935]: X-Project-Id: 1ca55f6933c840fb8703bcabbd620ed8 Apr 14 17:33:10 user devstack@n-api.service[61935]: X-Project-Name: tempest-VolumesGetTestJSON-2139784491 Apr 14 17:33:10 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:33:10 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:33:10 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ca55f6933c840fb8703bcabbd620ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1ca55f6933c840fb8703bcabbd620ed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1ca55f6933c840fb8703bcabbd620ed8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:33:10 user devstack@n-api.service[61935]: X-Tenant: tempest-VolumesGetTestJSON-2139784491 Apr 14 17:33:10 user devstack@n-api.service[61935]: X-Tenant-Id: 1ca55f6933c840fb8703bcabbd620ed8 Apr 14 17:33:10 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-VolumesGetTestJSON-2139784491 Apr 14 17:33:10 user devstack@n-api.service[61935]: X-User: tempest-VolumesGetTestJSON-2139784491-project-member Apr 14 17:33:10 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:33:10 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:33:10 user devstack@n-api.service[61935]: X-User-Id: fe1c43c626fd449ba4d593149a1572d6 Apr 14 17:33:10 user devstack@n-api.service[61935]: X-User-Name: tempest-VolumesGetTestJSON-2139784491-project-member Apr 14 17:33:10 user devstack@n-api.service[61935]: method: Apr 14 17:33:10 user devstack@n-api.service[61935]: exception: Volume 5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac could not be found. Apr 14 17:33:10 user devstack@n-api.service[61935]: action_args: {'id': '5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac'} Apr 14 17:33:10 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac could not be found. (HTTP 404) (Request-ID: req-bdcf7e45-dfe7-4f9e-912e-209ff12b3a23) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac could not be found. Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac could not be found. Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac could not be found. Apr 14 17:33:10 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:33:10 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a0c29f1b-cac1-4284-a250-59b102718a71 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] Returning 404 to user: Volume 5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:33:10 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-a0c29f1b-cac1-4284-a250-59b102718a71 tempest-VolumesGetTestJSON-2139784491 tempest-VolumesGetTestJSON-2139784491-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac" status: 404 len: 109 microversion: 2.1 time: 0.037383 Apr 14 17:33:10 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 350/1040] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 17:33:10 2023] GET /compute/v2.1/os-volumes/5e3b2f5d-58d7-4e9a-b3b2-31a2020a11ac => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:34:08 user devstack@n-api.service[61934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:34:08 user devstack@n-api.service[61934]: Fri Apr 14 17:34:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/os-volume_attachments (ip 10.0.0.210) !!! Apr 14 17:34:08 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:34:08 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=8 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:34:09 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b28c7519-216f-4aba-a95b-7bc2694a97c8", "device": "/dev/vdb"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:34:09 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:34:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:34:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:34:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:34:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:34:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:34:09 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:34:09 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-0e2b6357-232c-4eb4-923c-9bafd65d7040 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] 10.0.0.210 "POST /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.636470 Apr 14 17:34:09 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 346/1041] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 17:34:08 2023] POST /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/os-volume_attachments => generated 194 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:34:33 user devstack@n-api.service[61933]: ERROR oslo.messaging._drivers.impl_rabbit [-] [afd27a4e-5552-43ff-898c-c1fed5e8c593] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 17:34:33 user devstack@n-api.service[61933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:34:33 user devstack@n-api.service[61933]: Fri Apr 14 17:34:33 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/os-volume_attachments/b28c7519-216f-4aba-a95b-7bc2694a97c8 (ip 10.0.0.210) !!! Apr 14 17:34:33 user devstack@n-api.service[61933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:34:33 user devstack@n-api.service[61933]: Fri Apr 14 17:34:33 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/os-volume_attachments/b28c7519-216f-4aba-a95b-7bc2694a97c8 (ip 10.0.0.210) !!! Apr 14 17:34:33 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:34:33 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:34:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:34:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:34:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:34:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:34:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:34:33 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:34:33 user devstack@n-api.service[61933]: DEBUG nova.objects.instance [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lazy-loading 'services' on Instance uuid abe0d33a-5e2f-4b27-b79f-a1e934e7db49 {{(pid=61933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:34:33 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-8ab4f3da-508b-4e73-97f2-cf82adb4ce3b tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/os-volume_attachments/b28c7519-216f-4aba-a95b-7bc2694a97c8" status: 202 len: 0 microversion: 2.1 time: 0.175894 Apr 14 17:34:33 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 346/1042] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 17:34:33 2023] DELETE /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49/os-volume_attachments/b28c7519-216f-4aba-a95b-7bc2694a97c8 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:34:33 user devstack@n-api.service[61935]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:34:33 user devstack@n-api.service[61935]: Fri Apr 14 17:34:33 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49 (ip 10.0.0.210) !!! Apr 14 17:34:33 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:34:33 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:34:33 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:34:33 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:34:33 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:34:33 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:34:33 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:34:33 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:34:33 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Going to try to terminate instance {{(pid=61935) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:34:33 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-de322533-35d4-4a0c-98bc-edad07498f68 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49" status: 204 len: 0 microversion: 2.1 time: 0.137304 Apr 14 17:34:33 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 351/1043] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:34:33 2023] DELETE /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:34:33 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-0d7a6f19-0e65-4d18-947a-a40be68368d3 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:34:33 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-0d7a6f19-0e65-4d18-947a-a40be68368d3 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:34:33 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:34:33 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:34:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0d7a6f19-0e65-4d18-947a-a40be68368d3 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:34:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0d7a6f19-0e65-4d18-947a-a40be68368d3 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:34:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0d7a6f19-0e65-4d18-947a-a40be68368d3 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:34:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0d7a6f19-0e65-4d18-947a-a40be68368d3 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:34:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0d7a6f19-0e65-4d18-947a-a40be68368d3 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:34:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-0d7a6f19-0e65-4d18-947a-a40be68368d3 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:34:33 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-0d7a6f19-0e65-4d18-947a-a40be68368d3 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554e014a05a40c4bd070b4494314e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360f9e856f81453b80189e456a2269fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:34:33 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-0d7a6f19-0e65-4d18-947a-a40be68368d3 tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49" status: 200 len: 1547 microversion: 2.1 time: 0.235116 Apr 14 17:34:33 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 347/1044] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:34:33 2023] GET /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49 => generated 1547 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:34:35 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-797b4e32-afd8-488a-b5ab-314708a2b29f req-ea5bc212-3561-4bd9-a49d-c24b653fa747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe0d33a-5e2f-4b27-b79f-a1e934e7db49", "name": "network-vif-unplugged", "status": "completed", "tag": "8099356e-819f-4d82-8d19-38637909cf0c"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:34:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-797b4e32-afd8-488a-b5ab-314708a2b29f req-ea5bc212-3561-4bd9-a49d-c24b653fa747 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:34:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-797b4e32-afd8-488a-b5ab-314708a2b29f req-ea5bc212-3561-4bd9-a49d-c24b653fa747 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:34:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-797b4e32-afd8-488a-b5ab-314708a2b29f req-ea5bc212-3561-4bd9-a49d-c24b653fa747 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:34:35 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-797b4e32-afd8-488a-b5ab-314708a2b29f req-ea5bc212-3561-4bd9-a49d-c24b653fa747 service nova] Creating event network-vif-unplugged:8099356e-819f-4d82-8d19-38637909cf0c for instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 on user Apr 14 17:34:35 user devstack@n-api.service[61933]: INFO oslo.messaging._drivers.impl_rabbit [-] [afd27a4e-5552-43ff-898c-c1fed5e8c593] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 51486. Apr 14 17:34:35 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-797b4e32-afd8-488a-b5ab-314708a2b29f req-ea5bc212-3561-4bd9-a49d-c24b653fa747 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064730 Apr 14 17:34:35 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 347/1045] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:34:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:34:36 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-b4a0b519-a454-41b0-9fdb-482016f52aea req-948afd4a-483f-47f9-9ce6-149f1f0d09e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe0d33a-5e2f-4b27-b79f-a1e934e7db49", "name": "network-vif-deleted", "tag": "8099356e-819f-4d82-8d19-38637909cf0c"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:34:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-b4a0b519-a454-41b0-9fdb-482016f52aea req-948afd4a-483f-47f9-9ce6-149f1f0d09e4 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:34:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-b4a0b519-a454-41b0-9fdb-482016f52aea req-948afd4a-483f-47f9-9ce6-149f1f0d09e4 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:34:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-b4a0b519-a454-41b0-9fdb-482016f52aea req-948afd4a-483f-47f9-9ce6-149f1f0d09e4 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:34:36 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-b4a0b519-a454-41b0-9fdb-482016f52aea req-948afd4a-483f-47f9-9ce6-149f1f0d09e4 service nova] Creating event network-vif-deleted:8099356e-819f-4d82-8d19-38637909cf0c for instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 on user Apr 14 17:34:37 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-b4a0b519-a454-41b0-9fdb-482016f52aea req-948afd4a-483f-47f9-9ce6-149f1f0d09e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039054 Apr 14 17:34:37 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 352/1046] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:34:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:34:37 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe0d33a-5e2f-4b27-b79f-a1e934e7db49", "name": "network-vif-plugged", "status": "completed", "tag": "8099356e-819f-4d82-8d19-38637909cf0c"}, {"server_uuid": "abe0d33a-5e2f-4b27-b79f-a1e934e7db49", "name": "network-vif-plugged", "status": "completed", "tag": "8099356e-819f-4d82-8d19-38637909cf0c"}, {"server_uuid": "abe0d33a-5e2f-4b27-b79f-a1e934e7db49", "name": "network-vif-plugged", "status": "completed", "tag": "8099356e-819f-4d82-8d19-38637909cf0c"}, {"server_uuid": "abe0d33a-5e2f-4b27-b79f-a1e934e7db49", "name": "network-vif-unplugged", "status": "completed", "tag": "8099356e-819f-4d82-8d19-38637909cf0c"}, {"server_uuid": "abe0d33a-5e2f-4b27-b79f-a1e934e7db49", "name": "network-vif-plugged", "status": "completed", "tag": "8099356e-819f-4d82-8d19-38637909cf0c"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:34:37 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:34:37 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:34:37 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:34:37 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Creating event network-vif-plugged:8099356e-819f-4d82-8d19-38637909cf0c for instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 on user Apr 14 17:34:37 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Creating event network-vif-plugged:8099356e-819f-4d82-8d19-38637909cf0c for instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 on user Apr 14 17:34:37 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Creating event network-vif-plugged:8099356e-819f-4d82-8d19-38637909cf0c for instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 on user Apr 14 17:34:37 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Creating event network-vif-unplugged:8099356e-819f-4d82-8d19-38637909cf0c for instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 on user Apr 14 17:34:37 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] Creating event network-vif-plugged:8099356e-819f-4d82-8d19-38637909cf0c for instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 on user Apr 14 17:34:37 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-36800efc-d012-43d5-917a-a47f9247a6a1 req-23ede650-08d1-48ed-b872-8da66605c1a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.045628 Apr 14 17:34:37 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 348/1047] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:34:37 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:35:23 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:35:23 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:35:23 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-be90e0a6-4d77-4945-8e6d-5136fe107a7a tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:35:24 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-be90e0a6-4d77-4945-8e6d-5136fe107a7a tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] [instance: abe0d33a-5e2f-4b27-b79f-a1e934e7db49] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:35:24 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-be90e0a6-4d77-4945-8e6d-5136fe107a7a tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:35:24 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-be90e0a6-4d77-4945-8e6d-5136fe107a7a tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:35:24 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-be90e0a6-4d77-4945-8e6d-5136fe107a7a tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:35:24 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-be90e0a6-4d77-4945-8e6d-5136fe107a7a tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:35:24 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-be90e0a6-4d77-4945-8e6d-5136fe107a7a tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:35:24 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-be90e0a6-4d77-4945-8e6d-5136fe107a7a tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:35:24 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-be90e0a6-4d77-4945-8e6d-5136fe107a7a tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] HTTP exception thrown: Instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 could not be found. Apr 14 17:35:24 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-be90e0a6-4d77-4945-8e6d-5136fe107a7a tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Request method failure captured: Apr 14 17:35:24 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49 HTTP/1.1 Apr 14 17:35:24 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:35:24 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:35:24 user devstack@n-api.service[61933]: Connection: close Apr 14 17:35:24 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:35:24 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:35:24 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:35:24 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:35:24 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:35:24 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOY1RGB_qBcTds-YjtOt3lyYJamcWfuoRcExUOLuV-xr3mDDQaeFPGulwqQRKU_H8RFawcqs9TALQmvmZgNkJr_0jROKjZeRSFVYhoqlXZFgTCzZk0etnssK9rspAkIHK8KsO3CzZlo8rAsVhOG-Eei7b2DLBwJzFdctRVBEKa-SldVA Apr 14 17:35:24 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:35:24 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:35:24 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:35:24 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:35:24 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:35:24 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:35:24 user devstack@n-api.service[61933]: X-Project-Id: 360f9e856f81453b80189e456a2269fe Apr 14 17:35:24 user devstack@n-api.service[61933]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1090163427 Apr 14 17:35:24 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:35:24 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:35:24 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/360f9e856f81453b80189e456a2269fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/360f9e856f81453b80189e456a2269fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/360f9e856f81453b80189e456a2269fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:35:24 user devstack@n-api.service[61933]: X-Tenant: tempest-VolumesSnapshotTestJSON-1090163427 Apr 14 17:35:24 user devstack@n-api.service[61933]: X-Tenant-Id: 360f9e856f81453b80189e456a2269fe Apr 14 17:35:24 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1090163427 Apr 14 17:35:24 user devstack@n-api.service[61933]: X-User: tempest-VolumesSnapshotTestJSON-1090163427-project-member Apr 14 17:35:24 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:35:24 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:35:24 user devstack@n-api.service[61933]: X-User-Id: f554e014a05a40c4bd070b4494314e33 Apr 14 17:35:24 user devstack@n-api.service[61933]: X-User-Name: tempest-VolumesSnapshotTestJSON-1090163427-project-member Apr 14 17:35:24 user devstack@n-api.service[61933]: method: > Apr 14 17:35:24 user devstack@n-api.service[61933]: exception: Instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 could not be found. Apr 14 17:35:24 user devstack@n-api.service[61933]: action_args: {'id': 'abe0d33a-5e2f-4b27-b79f-a1e934e7db49'} Apr 14 17:35:24 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 could not be found. Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 could not be found. Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 could not be found. Apr 14 17:35:24 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:35:24 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-be90e0a6-4d77-4945-8e6d-5136fe107a7a tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] Returning 404 to user: Instance abe0d33a-5e2f-4b27-b79f-a1e934e7db49 could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:35:24 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-be90e0a6-4d77-4945-8e6d-5136fe107a7a tempest-VolumesSnapshotTestJSON-1090163427 tempest-VolumesSnapshotTestJSON-1090163427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49" status: 404 len: 111 microversion: 2.1 time: 0.039586 Apr 14 17:35:24 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 348/1048] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:35:23 2023] GET /compute/v2.1/servers/abe0d33a-5e2f-4b27-b79f-a1e934e7db49 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:36:21 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:36:21 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:36:21 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-5e32e7a6-ddfc-40e6-bf53-e31e10bdb16a tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Action: 'create', calling method: .version_select at 0x7fe19cfadd80>, body: {"keypair": {"name": "tempest-TestShelveInstance-291918457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHT1U7XDG7RnEtgS2xjqweyDn7tiGrqQpot4AWIq0XrwxuP3sFX0kklQCONCkEzA0dnykTrQih+YLx4JYuN7eOJ9ov54yHPXPwLmjsJV2QQNMEGpbqbsUsga7ih7IQEhhw=="}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:36:21 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-5e32e7a6-ddfc-40e6-bf53-e31e10bdb16a tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Getting quotas for project 684b940d5fdd4a47a9132ae253e07b1c. Resources: {'key_pairs'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:36:21 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-5e32e7a6-ddfc-40e6-bf53-e31e10bdb16a tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Getting quotas for user 695d06748c274b01830f3bb9216d3ad8 and project 684b940d5fdd4a47a9132ae253e07b1c. Resources: {'key_pairs'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:36:21 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-5e32e7a6-ddfc-40e6-bf53-e31e10bdb16a tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.275685 Apr 14 17:36:21 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 353/1049] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 17:36:21 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:36:26 user devstack@n-api.service[61934]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f9c1eadf-1445-413a-a06d-1e6fd2e4b8ab] AMQP server on 10.0.0.210:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 14 17:36:26 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:36:26 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=8 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:36:26 user devstack@n-api.service[61934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:36:26 user devstack@n-api.service[61934]: Fri Apr 14 17:36:26 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 14 17:36:26 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1961689222", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-291918457", "security_groups": [{"name": "tempest-secgroup-smoke-1340524361"}], "networks": [{"uuid": "df6d9060-35ac-422b-9484-43dceb1606ad"}], "block_device_mapping_v2": [{"uuid": "4db052d4-23e3-49f9-b401-4fea76efe595", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:36:26 user devstack@n-api.service[61934]: DEBUG nova.network.neutron [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] validate_networks() for [('df6d9060-35ac-422b-9484-43dceb1606ad', None, None, None, None, None)] {{(pid=61934) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:36:27 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Flavor limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:36:27 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Image limits 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:36:27 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Flavor pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:36:27 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Image pref 0:0:0 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:36:27 user devstack@n-api.service[61934]: DEBUG nova.virt.hardware [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:36:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:36:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:36:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:36:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:36:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:36:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:36:27 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Getting quotas for project 684b940d5fdd4a47a9132ae253e07b1c. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:36:27 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Getting quotas for user 695d06748c274b01830f3bb9216d3ad8 and project 684b940d5fdd4a47a9132ae253e07b1c. Resources: {'cores', 'ram', 'instances'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:36:27 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Going to run 1 instances... {{(pid=61934) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:36:27 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4db052d4-23e3-49f9-b401-4fea76efe595',volume_size=None,volume_type=None)] {{(pid=61934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:36:27 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-39294f2c-4800-4b92-98fb-135f4177b9f6 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.960188 Apr 14 17:36:27 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 349/1050] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:36:26 2023] POST /compute/v2.1/servers => generated 404 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:36:27 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:36:27 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b7b8a819-47cc-4f5c-ac1c-c8bf7c530275 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:36:27 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-b7b8a819-47cc-4f5c-ac1c-c8bf7c530275 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:36:27 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-b7b8a819-47cc-4f5c-ac1c-c8bf7c530275 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695d06748c274b01830f3bb9216d3ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b940d5fdd4a47a9132ae253e07b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:36:27 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-b7b8a819-47cc-4f5c-ac1c-c8bf7c530275 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959" status: 200 len: 1083 microversion: 2.1 time: 0.135206 Apr 14 17:36:27 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 349/1051] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:36:27 2023] GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959 => generated 1083 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:36:29 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-90e96254-af5e-4460-92e8-151f82c9caf5 req-cb7388de-c129-4902-9c5c-45a062075e19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d921bfb3-1d65-44fe-ad66-7821d9fa2959", "tag": "8d285b5b-c38f-43ea-9399-786253f061d5"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:36:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-90e96254-af5e-4460-92e8-151f82c9caf5 req-cb7388de-c129-4902-9c5c-45a062075e19 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:36:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-90e96254-af5e-4460-92e8-151f82c9caf5 req-cb7388de-c129-4902-9c5c-45a062075e19 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:36:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-90e96254-af5e-4460-92e8-151f82c9caf5 req-cb7388de-c129-4902-9c5c-45a062075e19 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:36:29 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-90e96254-af5e-4460-92e8-151f82c9caf5 req-cb7388de-c129-4902-9c5c-45a062075e19 service nova] Creating event network-changed:8d285b5b-c38f-43ea-9399-786253f061d5 for instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 on user Apr 14 17:36:29 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-90e96254-af5e-4460-92e8-151f82c9caf5 req-cb7388de-c129-4902-9c5c-45a062075e19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085472 Apr 14 17:36:29 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 354/1052] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:36:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:36:36 user devstack@n-api.service[61934]: INFO oslo.messaging._drivers.impl_rabbit [-] [f9c1eadf-1445-413a-a06d-1e6fd2e4b8ab] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 53316. Apr 14 17:36:36 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-766173c7-3c35-4e25-9d0c-2ec057d9e7a8 req-ca8bd2f5-34a3-44f7-86f6-75577985aac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d921bfb3-1d65-44fe-ad66-7821d9fa2959", "name": "network-vif-plugged", "status": "completed", "tag": "8d285b5b-c38f-43ea-9399-786253f061d5"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:36:36 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-766173c7-3c35-4e25-9d0c-2ec057d9e7a8 req-ca8bd2f5-34a3-44f7-86f6-75577985aac7 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:36:36 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-766173c7-3c35-4e25-9d0c-2ec057d9e7a8 req-ca8bd2f5-34a3-44f7-86f6-75577985aac7 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:36:36 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-766173c7-3c35-4e25-9d0c-2ec057d9e7a8 req-ca8bd2f5-34a3-44f7-86f6-75577985aac7 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:36:36 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-766173c7-3c35-4e25-9d0c-2ec057d9e7a8 req-ca8bd2f5-34a3-44f7-86f6-75577985aac7 service nova] Creating event network-vif-plugged:8d285b5b-c38f-43ea-9399-786253f061d5 for instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 on user Apr 14 17:36:36 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-766173c7-3c35-4e25-9d0c-2ec057d9e7a8 req-ca8bd2f5-34a3-44f7-86f6-75577985aac7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182300 Apr 14 17:36:36 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 350/1053] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:36:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:36:38 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-f7f837e3-e6ad-466d-bd07-d822eafc0712 req-c6a1e136-b9af-47ca-9a96-e37a1789577b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d921bfb3-1d65-44fe-ad66-7821d9fa2959", "name": "network-vif-plugged", "status": "completed", "tag": "8d285b5b-c38f-43ea-9399-786253f061d5"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:36:38 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:36:38 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:36:38 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:36:38 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-f7f837e3-e6ad-466d-bd07-d822eafc0712 req-c6a1e136-b9af-47ca-9a96-e37a1789577b service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:36:38 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-f7f837e3-e6ad-466d-bd07-d822eafc0712 req-c6a1e136-b9af-47ca-9a96-e37a1789577b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:36:38 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-f7f837e3-e6ad-466d-bd07-d822eafc0712 req-c6a1e136-b9af-47ca-9a96-e37a1789577b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:36:38 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-f7f837e3-e6ad-466d-bd07-d822eafc0712 req-c6a1e136-b9af-47ca-9a96-e37a1789577b service nova] Creating event network-vif-plugged:8d285b5b-c38f-43ea-9399-786253f061d5 for instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 on user Apr 14 17:36:38 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-f7f837e3-e6ad-466d-bd07-d822eafc0712 req-c6a1e136-b9af-47ca-9a96-e37a1789577b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038285 Apr 14 17:36:38 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 350/1054] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:36:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:37:17 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:37:17 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:37:17 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:37:17 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-72d8d129-e577-4fde-9050-9fa223dc78eb tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:37:17 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-72d8d129-e577-4fde-9050-9fa223dc78eb tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:37:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-72d8d129-e577-4fde-9050-9fa223dc78eb tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:37:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-72d8d129-e577-4fde-9050-9fa223dc78eb tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:37:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-72d8d129-e577-4fde-9050-9fa223dc78eb tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:37:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-72d8d129-e577-4fde-9050-9fa223dc78eb tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:37:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-72d8d129-e577-4fde-9050-9fa223dc78eb tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:37:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-72d8d129-e577-4fde-9050-9fa223dc78eb tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:37:17 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-72d8d129-e577-4fde-9050-9fa223dc78eb tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695d06748c274b01830f3bb9216d3ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b940d5fdd4a47a9132ae253e07b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:37:17 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-72d8d129-e577-4fde-9050-9fa223dc78eb tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959" status: 200 len: 1432 microversion: 2.1 time: 0.281460 Apr 14 17:37:17 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 355/1055] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:37:17 2023] GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959 => generated 1432 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:38:17 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:38:17 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:38:17 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:38:17 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:38:17 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-299af588-ab61-4eb6-93dc-98f89a4584f8 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:38:17 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-299af588-ab61-4eb6-93dc-98f89a4584f8 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:38:17 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-299af588-ab61-4eb6-93dc-98f89a4584f8 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:38:17 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-299af588-ab61-4eb6-93dc-98f89a4584f8 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:38:17 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-299af588-ab61-4eb6-93dc-98f89a4584f8 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:38:17 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-299af588-ab61-4eb6-93dc-98f89a4584f8 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:38:17 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-299af588-ab61-4eb6-93dc-98f89a4584f8 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:38:17 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-299af588-ab61-4eb6-93dc-98f89a4584f8 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:38:18 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-299af588-ab61-4eb6-93dc-98f89a4584f8 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695d06748c274b01830f3bb9216d3ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b940d5fdd4a47a9132ae253e07b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:38:18 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-299af588-ab61-4eb6-93dc-98f89a4584f8 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959" status: 200 len: 1432 microversion: 2.1 time: 0.255707 Apr 14 17:38:18 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 351/1056] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:38:17 2023] GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959 => generated 1432 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:38:19 user devstack@n-api.service[61933]: ERROR oslo.messaging._drivers.impl_rabbit [-] [afd27a4e-5552-43ff-898c-c1fed5e8c593] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 17:38:19 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:38:19 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:38:19 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-b905e963-837e-4e0b-bc87-c2bfbf6a81aa req-f755230f-bc3e-450d-9f9a-8dc4e6afe6fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d921bfb3-1d65-44fe-ad66-7821d9fa2959", "tag": "8d285b5b-c38f-43ea-9399-786253f061d5"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:38:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-b905e963-837e-4e0b-bc87-c2bfbf6a81aa req-f755230f-bc3e-450d-9f9a-8dc4e6afe6fe service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:38:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-b905e963-837e-4e0b-bc87-c2bfbf6a81aa req-f755230f-bc3e-450d-9f9a-8dc4e6afe6fe service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:38:19 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-b905e963-837e-4e0b-bc87-c2bfbf6a81aa req-f755230f-bc3e-450d-9f9a-8dc4e6afe6fe service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:38:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-b905e963-837e-4e0b-bc87-c2bfbf6a81aa req-f755230f-bc3e-450d-9f9a-8dc4e6afe6fe service nova] Creating event network-changed:8d285b5b-c38f-43ea-9399-786253f061d5 for instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 on user Apr 14 17:38:19 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-b905e963-837e-4e0b-bc87-c2bfbf6a81aa req-f755230f-bc3e-450d-9f9a-8dc4e6afe6fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039513 Apr 14 17:38:19 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 351/1057] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:38:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:38:20 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:38:20 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:38:20 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:38:20 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:38:20 user devstack@n-api.service[61935]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:38:20 user devstack@n-api.service[61935]: Fri Apr 14 17:38:20 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959/action (ip 10.0.0.210) !!! Apr 14 17:38:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:38:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:38:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:38:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:38:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:38:20 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:38:20 user devstack@n-api.service[61935]: DEBUG nova.objects.instance [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lazy-loading 'flavor' on Instance uuid d921bfb3-1d65-44fe-ad66-7821d9fa2959 {{(pid=61935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 17:38:20 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-74c3fa23-c308-4e51-a0f8-7db59f8286a7 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959/action" status: 202 len: 0 microversion: 2.1 time: 0.109837 Apr 14 17:38:20 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 356/1058] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:38:20 2023] POST /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:38:20 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-b0aaea7c-3fba-48a4-b363-2b0070cf07c9 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:38:20 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-b0aaea7c-3fba-48a4-b363-2b0070cf07c9 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:38:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b0aaea7c-3fba-48a4-b363-2b0070cf07c9 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:38:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b0aaea7c-3fba-48a4-b363-2b0070cf07c9 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:38:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b0aaea7c-3fba-48a4-b363-2b0070cf07c9 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:38:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b0aaea7c-3fba-48a4-b363-2b0070cf07c9 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:38:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b0aaea7c-3fba-48a4-b363-2b0070cf07c9 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:38:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-b0aaea7c-3fba-48a4-b363-2b0070cf07c9 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:38:20 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-b0aaea7c-3fba-48a4-b363-2b0070cf07c9 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695d06748c274b01830f3bb9216d3ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b940d5fdd4a47a9132ae253e07b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:38:20 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-b0aaea7c-3fba-48a4-b363-2b0070cf07c9 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959" status: 200 len: 1438 microversion: 2.1 time: 0.185579 Apr 14 17:38:20 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 352/1059] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:38:20 2023] GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959 => generated 1438 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:38:20 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-64b455cc-7f1c-4c85-98cb-4aea59d5c34e req-86e9d817-3f19-4eb8-83f5-e0a5e44447f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d921bfb3-1d65-44fe-ad66-7821d9fa2959", "name": "network-vif-unplugged", "status": "completed", "tag": "8d285b5b-c38f-43ea-9399-786253f061d5"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:38:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-64b455cc-7f1c-4c85-98cb-4aea59d5c34e req-86e9d817-3f19-4eb8-83f5-e0a5e44447f2 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:38:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-64b455cc-7f1c-4c85-98cb-4aea59d5c34e req-86e9d817-3f19-4eb8-83f5-e0a5e44447f2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:38:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-64b455cc-7f1c-4c85-98cb-4aea59d5c34e req-86e9d817-3f19-4eb8-83f5-e0a5e44447f2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:38:20 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-64b455cc-7f1c-4c85-98cb-4aea59d5c34e req-86e9d817-3f19-4eb8-83f5-e0a5e44447f2 service nova] Creating event network-vif-unplugged:8d285b5b-c38f-43ea-9399-786253f061d5 for instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 on user Apr 14 17:38:20 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-64b455cc-7f1c-4c85-98cb-4aea59d5c34e req-86e9d817-3f19-4eb8-83f5-e0a5e44447f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036755 Apr 14 17:38:20 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 352/1060] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:38:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:38:22 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-85f715f8-9f63-4a59-962d-a6d8a21fc0cd req-4e096d23-e3f6-462b-9515-477aa319d6fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d921bfb3-1d65-44fe-ad66-7821d9fa2959", "tag": "8d285b5b-c38f-43ea-9399-786253f061d5"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:38:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-85f715f8-9f63-4a59-962d-a6d8a21fc0cd req-4e096d23-e3f6-462b-9515-477aa319d6fe service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:38:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-85f715f8-9f63-4a59-962d-a6d8a21fc0cd req-4e096d23-e3f6-462b-9515-477aa319d6fe service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:38:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-85f715f8-9f63-4a59-962d-a6d8a21fc0cd req-4e096d23-e3f6-462b-9515-477aa319d6fe service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:38:22 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-85f715f8-9f63-4a59-962d-a6d8a21fc0cd req-4e096d23-e3f6-462b-9515-477aa319d6fe service nova] Creating event network-changed:8d285b5b-c38f-43ea-9399-786253f061d5 for instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 on user Apr 14 17:38:22 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-85f715f8-9f63-4a59-962d-a6d8a21fc0cd req-4e096d23-e3f6-462b-9515-477aa319d6fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031897 Apr 14 17:38:22 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 357/1061] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:38:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:38:22 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-a746d0ab-f217-433a-9339-d0c2bc3c8dc4 req-dead9e36-d033-4beb-9b88-e70376b9ee85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d921bfb3-1d65-44fe-ad66-7821d9fa2959", "name": "network-vif-plugged", "status": "completed", "tag": "8d285b5b-c38f-43ea-9399-786253f061d5"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:38:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a746d0ab-f217-433a-9339-d0c2bc3c8dc4 req-dead9e36-d033-4beb-9b88-e70376b9ee85 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:38:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a746d0ab-f217-433a-9339-d0c2bc3c8dc4 req-dead9e36-d033-4beb-9b88-e70376b9ee85 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:38:22 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-a746d0ab-f217-433a-9339-d0c2bc3c8dc4 req-dead9e36-d033-4beb-9b88-e70376b9ee85 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:38:22 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-a746d0ab-f217-433a-9339-d0c2bc3c8dc4 req-dead9e36-d033-4beb-9b88-e70376b9ee85 service nova] Creating event network-vif-plugged:8d285b5b-c38f-43ea-9399-786253f061d5 for instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 on user Apr 14 17:38:22 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-a746d0ab-f217-433a-9339-d0c2bc3c8dc4 req-dead9e36-d033-4beb-9b88-e70376b9ee85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033179 Apr 14 17:38:22 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 353/1062] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:38:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:39:10 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-c8db402c-993a-4895-a12b-e126a61d9576 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:39:10 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-c8db402c-993a-4895-a12b-e126a61d9576 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:39:10 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:39:10 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:39:10 user devstack@n-api.service[61933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 17:39:10 user devstack@n-api.service[61933]: Fri Apr 14 17:39:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959 (ip 10.0.0.210) !!! Apr 14 17:39:10 user devstack@n-api.service[61933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 17:39:10 user devstack@n-api.service[61933]: Fri Apr 14 17:39:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959 (ip 10.0.0.210) !!! Apr 14 17:39:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c8db402c-993a-4895-a12b-e126a61d9576 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:39:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c8db402c-993a-4895-a12b-e126a61d9576 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:39:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c8db402c-993a-4895-a12b-e126a61d9576 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:39:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c8db402c-993a-4895-a12b-e126a61d9576 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:39:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c8db402c-993a-4895-a12b-e126a61d9576 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:39:10 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c8db402c-993a-4895-a12b-e126a61d9576 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:39:10 user devstack@n-api.service[61933]: INFO oslo.messaging._drivers.impl_rabbit [-] [afd27a4e-5552-43ff-898c-c1fed5e8c593] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 60564. Apr 14 17:39:10 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-c8db402c-993a-4895-a12b-e126a61d9576 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695d06748c274b01830f3bb9216d3ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b940d5fdd4a47a9132ae253e07b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:39:10 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-c8db402c-993a-4895-a12b-e126a61d9576 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959" status: 200 len: 1498 microversion: 2.1 time: 0.272681 Apr 14 17:39:10 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 353/1063] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:39:10 2023] GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959 => generated 1498 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:40:10 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:40:10 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:40:10 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:40:10 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:40:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:40:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:40:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:40:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:40:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:40:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:40:10 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61935) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 17:40:11 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-9da59d3d-514c-48a5-aea7-be3713448e4e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959/action" status: 202 len: 0 microversion: 2.1 time: 0.193805 Apr 14 17:40:11 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 358/1064] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:40:10 2023] POST /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:40:11 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:40:11 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=14 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:40:11 user devstack@n-api.service[61934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:40:11 user devstack@n-api.service[61934]: Fri Apr 14 17:40:11 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959 (ip 10.0.0.210) !!! Apr 14 17:40:11 user devstack@n-api.service[61934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:40:11 user devstack@n-api.service[61934]: Fri Apr 14 17:40:11 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959 (ip 10.0.0.210) !!! Apr 14 17:40:11 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-15167a4a-d1a3-4c47-901a-e77ae693a43f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:40:11 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-15167a4a-d1a3-4c47-901a-e77ae693a43f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:40:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-15167a4a-d1a3-4c47-901a-e77ae693a43f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:40:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-15167a4a-d1a3-4c47-901a-e77ae693a43f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:40:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-15167a4a-d1a3-4c47-901a-e77ae693a43f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:40:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-15167a4a-d1a3-4c47-901a-e77ae693a43f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:40:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-15167a4a-d1a3-4c47-901a-e77ae693a43f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:40:11 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-15167a4a-d1a3-4c47-901a-e77ae693a43f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:40:11 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-15167a4a-d1a3-4c47-901a-e77ae693a43f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695d06748c274b01830f3bb9216d3ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b940d5fdd4a47a9132ae253e07b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:40:11 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-15167a4a-d1a3-4c47-901a-e77ae693a43f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959" status: 200 len: 1506 microversion: 2.1 time: 0.260725 Apr 14 17:40:11 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 354/1065] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:40:11 2023] GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959 => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:40:17 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-6aca0b00-cd8e-452e-9bd9-a614b913f9fa req-51dfa353-6d37-4ed7-8ff1-14dae7c588be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d921bfb3-1d65-44fe-ad66-7821d9fa2959", "tag": "8d285b5b-c38f-43ea-9399-786253f061d5"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:40:17 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:40:17 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:40:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-6aca0b00-cd8e-452e-9bd9-a614b913f9fa req-51dfa353-6d37-4ed7-8ff1-14dae7c588be service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:40:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-6aca0b00-cd8e-452e-9bd9-a614b913f9fa req-51dfa353-6d37-4ed7-8ff1-14dae7c588be service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:40:17 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-6aca0b00-cd8e-452e-9bd9-a614b913f9fa req-51dfa353-6d37-4ed7-8ff1-14dae7c588be service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:40:17 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-6aca0b00-cd8e-452e-9bd9-a614b913f9fa req-51dfa353-6d37-4ed7-8ff1-14dae7c588be service nova] Creating event network-changed:8d285b5b-c38f-43ea-9399-786253f061d5 for instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 on user Apr 14 17:40:17 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-6aca0b00-cd8e-452e-9bd9-a614b913f9fa req-51dfa353-6d37-4ed7-8ff1-14dae7c588be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040208 Apr 14 17:40:17 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 354/1066] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:40:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:40:21 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:40:21 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:40:21 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-7507467b-c252-4765-9576-3a9361b46a1f req-86e47bf1-ebc4-4ee9-89b4-22d2a1f5143d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d921bfb3-1d65-44fe-ad66-7821d9fa2959", "name": "network-vif-plugged", "status": "completed", "tag": "8d285b5b-c38f-43ea-9399-786253f061d5"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:40:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-7507467b-c252-4765-9576-3a9361b46a1f req-86e47bf1-ebc4-4ee9-89b4-22d2a1f5143d service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:40:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-7507467b-c252-4765-9576-3a9361b46a1f req-86e47bf1-ebc4-4ee9-89b4-22d2a1f5143d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:40:21 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-7507467b-c252-4765-9576-3a9361b46a1f req-86e47bf1-ebc4-4ee9-89b4-22d2a1f5143d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:40:21 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-7507467b-c252-4765-9576-3a9361b46a1f req-86e47bf1-ebc4-4ee9-89b4-22d2a1f5143d service nova] Creating event network-vif-plugged:8d285b5b-c38f-43ea-9399-786253f061d5 for instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 on user Apr 14 17:40:21 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-7507467b-c252-4765-9576-3a9361b46a1f req-86e47bf1-ebc4-4ee9-89b4-22d2a1f5143d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038731 Apr 14 17:40:21 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 359/1067] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:40:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:40:23 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-d9dbdf6a-3e0d-4070-a140-c00746c54029 req-c28fc6f0-4d77-42e4-bb58-9097f915e069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d921bfb3-1d65-44fe-ad66-7821d9fa2959", "name": "network-vif-plugged", "status": "completed", "tag": "8d285b5b-c38f-43ea-9399-786253f061d5"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:40:23 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:40:23 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:40:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-d9dbdf6a-3e0d-4070-a140-c00746c54029 req-c28fc6f0-4d77-42e4-bb58-9097f915e069 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:40:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-d9dbdf6a-3e0d-4070-a140-c00746c54029 req-c28fc6f0-4d77-42e4-bb58-9097f915e069 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:40:23 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-d9dbdf6a-3e0d-4070-a140-c00746c54029 req-c28fc6f0-4d77-42e4-bb58-9097f915e069 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:40:23 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-d9dbdf6a-3e0d-4070-a140-c00746c54029 req-c28fc6f0-4d77-42e4-bb58-9097f915e069 service nova] Creating event network-vif-plugged:8d285b5b-c38f-43ea-9399-786253f061d5 for instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 on user Apr 14 17:40:23 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-d9dbdf6a-3e0d-4070-a140-c00746c54029 req-c28fc6f0-4d77-42e4-bb58-9097f915e069 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034317 Apr 14 17:40:23 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 355/1068] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:40:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:41:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-75c20938-540e-453f-a7a5-a59d27403869 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:41:01 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-75c20938-540e-453f-a7a5-a59d27403869 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:41:01 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:41:01 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:41:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-75c20938-540e-453f-a7a5-a59d27403869 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:41:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-75c20938-540e-453f-a7a5-a59d27403869 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:41:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-75c20938-540e-453f-a7a5-a59d27403869 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:41:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-75c20938-540e-453f-a7a5-a59d27403869 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:41:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-75c20938-540e-453f-a7a5-a59d27403869 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:41:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-75c20938-540e-453f-a7a5-a59d27403869 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:41:01 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-75c20938-540e-453f-a7a5-a59d27403869 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695d06748c274b01830f3bb9216d3ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b940d5fdd4a47a9132ae253e07b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:41:01 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-75c20938-540e-453f-a7a5-a59d27403869 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959" status: 200 len: 1551 microversion: 2.1 time: 0.230540 Apr 14 17:41:01 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 355/1069] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:41:01 2023] GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959 => generated 1551 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:42:02 user devstack@n-api.service[61935]: ERROR oslo.messaging._drivers.impl_rabbit [-] [08b4fb43-252f-49c7-a4f2-e609853ccb81] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 17:42:02 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:42:02 user devstack@n-api.service[61935]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:42:02 user devstack@n-api.service[61935]: Fri Apr 14 17:42:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959 (ip 10.0.0.210) !!! Apr 14 17:42:02 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:42:02 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:42:02 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:42:02 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:42:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:42:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:42:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:42:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:42:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:42:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:42:02 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Going to try to terminate instance {{(pid=61935) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:42:02 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-947d1dca-da39-4a72-a19b-379c8958d94d req-b3d86469-bd1e-4051-8901-5d4e98c4da5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d921bfb3-1d65-44fe-ad66-7821d9fa2959", "tag": "8d285b5b-c38f-43ea-9399-786253f061d5"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:42:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-947d1dca-da39-4a72-a19b-379c8958d94d req-b3d86469-bd1e-4051-8901-5d4e98c4da5e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:42:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-947d1dca-da39-4a72-a19b-379c8958d94d req-b3d86469-bd1e-4051-8901-5d4e98c4da5e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:42:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-947d1dca-da39-4a72-a19b-379c8958d94d req-b3d86469-bd1e-4051-8901-5d4e98c4da5e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:42:02 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-947d1dca-da39-4a72-a19b-379c8958d94d req-b3d86469-bd1e-4051-8901-5d4e98c4da5e service nova] Creating event network-changed:8d285b5b-c38f-43ea-9399-786253f061d5 for instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 on user Apr 14 17:42:02 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-947d1dca-da39-4a72-a19b-379c8958d94d req-b3d86469-bd1e-4051-8901-5d4e98c4da5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089115 Apr 14 17:42:02 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 356/1070] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:42:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:42:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-d4297602-9892-4b67-9fae-40cea3f6328f tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959" status: 204 len: 0 microversion: 2.1 time: 0.121263 Apr 14 17:42:02 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 360/1071] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:42:02 2023] DELETE /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:42:02 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:42:02 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:42:02 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-0cce220e-6e62-4cc5-bd4f-5875b01bb229 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:42:02 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-0cce220e-6e62-4cc5-bd4f-5875b01bb229 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:42:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0cce220e-6e62-4cc5-bd4f-5875b01bb229 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:42:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0cce220e-6e62-4cc5-bd4f-5875b01bb229 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:42:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0cce220e-6e62-4cc5-bd4f-5875b01bb229 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:42:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0cce220e-6e62-4cc5-bd4f-5875b01bb229 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:42:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0cce220e-6e62-4cc5-bd4f-5875b01bb229 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:42:02 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-0cce220e-6e62-4cc5-bd4f-5875b01bb229 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:42:02 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-0cce220e-6e62-4cc5-bd4f-5875b01bb229 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695d06748c274b01830f3bb9216d3ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b940d5fdd4a47a9132ae253e07b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:42:02 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-0cce220e-6e62-4cc5-bd4f-5875b01bb229 tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959" status: 200 len: 1557 microversion: 2.1 time: 0.493679 Apr 14 17:42:02 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 356/1072] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:42:02 2023] GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959 => generated 1557 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:42:04 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-7b014892-4a83-45b5-ae93-bfa7f16dd076 req-8e8d9479-9fd9-4d00-b1bc-68d14c6adb7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d921bfb3-1d65-44fe-ad66-7821d9fa2959", "name": "network-vif-deleted", "tag": "8d285b5b-c38f-43ea-9399-786253f061d5"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:42:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-7b014892-4a83-45b5-ae93-bfa7f16dd076 req-8e8d9479-9fd9-4d00-b1bc-68d14c6adb7e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:42:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-7b014892-4a83-45b5-ae93-bfa7f16dd076 req-8e8d9479-9fd9-4d00-b1bc-68d14c6adb7e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:42:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-7b014892-4a83-45b5-ae93-bfa7f16dd076 req-8e8d9479-9fd9-4d00-b1bc-68d14c6adb7e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:42:04 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-7b014892-4a83-45b5-ae93-bfa7f16dd076 req-8e8d9479-9fd9-4d00-b1bc-68d14c6adb7e service nova] Creating event network-vif-deleted:8d285b5b-c38f-43ea-9399-786253f061d5 for instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 on user Apr 14 17:42:04 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-7b014892-4a83-45b5-ae93-bfa7f16dd076 req-8e8d9479-9fd9-4d00-b1bc-68d14c6adb7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082197 Apr 14 17:42:04 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 357/1073] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:42:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:42:04 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d921bfb3-1d65-44fe-ad66-7821d9fa2959", "name": "network-vif-unplugged", "status": "completed", "tag": "8d285b5b-c38f-43ea-9399-786253f061d5"}, {"server_uuid": "d921bfb3-1d65-44fe-ad66-7821d9fa2959", "name": "network-vif-plugged", "status": "completed", "tag": "8d285b5b-c38f-43ea-9399-786253f061d5"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:42:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:42:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:42:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:42:04 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] Creating event network-vif-unplugged:8d285b5b-c38f-43ea-9399-786253f061d5 for instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 on user Apr 14 17:42:04 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] Creating event network-vif-plugged:8d285b5b-c38f-43ea-9399-786253f061d5 for instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 on user Apr 14 17:42:04 user devstack@n-api.service[61935]: INFO oslo.messaging._drivers.impl_rabbit [-] [08b4fb43-252f-49c7-a4f2-e609853ccb81] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 37232. Apr 14 17:42:04 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-503db29b-b3f8-4686-a192-2e0a3d62112a req-d4173610-441f-4c48-9841-d97512508b5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.037169 Apr 14 17:42:04 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 361/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:42:04 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:42:53 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-08d9b67a-b541-4128-a2e6-5e0353a396ae tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:42:53 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-08d9b67a-b541-4128-a2e6-5e0353a396ae tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] [instance: d921bfb3-1d65-44fe-ad66-7821d9fa2959] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:42:53 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:42:53 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:42:53 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-08d9b67a-b541-4128-a2e6-5e0353a396ae tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:42:53 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-08d9b67a-b541-4128-a2e6-5e0353a396ae tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:42:53 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-08d9b67a-b541-4128-a2e6-5e0353a396ae tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:42:53 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-08d9b67a-b541-4128-a2e6-5e0353a396ae tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:42:53 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-08d9b67a-b541-4128-a2e6-5e0353a396ae tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:42:53 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-08d9b67a-b541-4128-a2e6-5e0353a396ae tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:42:53 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-08d9b67a-b541-4128-a2e6-5e0353a396ae tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] HTTP exception thrown: Instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 could not be found. Apr 14 17:42:53 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-08d9b67a-b541-4128-a2e6-5e0353a396ae tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Request method failure captured: Apr 14 17:42:53 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959 HTTP/1.1 Apr 14 17:42:53 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:42:53 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:42:53 user devstack@n-api.service[61933]: Connection: close Apr 14 17:42:53 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:42:53 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:42:53 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:42:53 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:42:53 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:42:53 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOY8OgUKURB4U5FqSSy8NqCynuv5Qmf6jQUY664g1QQcY-q2ntiXywsnTAIHTCW6J0iH0QX_2DDvay51Z8fSZb27wzsGZ0SbKXOPmwTbggRQDjd0ywdEGD3v2qTmEir2GhPZv_TJSgB7MOIHyFrCKxPhXuXMgM-hdeYTxJz-X_IQ0dEw Apr 14 17:42:53 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:42:53 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:42:53 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:42:53 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:42:53 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:42:53 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:42:53 user devstack@n-api.service[61933]: X-Project-Id: 684b940d5fdd4a47a9132ae253e07b1c Apr 14 17:42:53 user devstack@n-api.service[61933]: X-Project-Name: tempest-TestShelveInstance-1112839499 Apr 14 17:42:53 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:42:53 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:42:53 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/684b940d5fdd4a47a9132ae253e07b1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/684b940d5fdd4a47a9132ae253e07b1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/684b940d5fdd4a47a9132ae253e07b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:42:53 user devstack@n-api.service[61933]: X-Tenant: tempest-TestShelveInstance-1112839499 Apr 14 17:42:53 user devstack@n-api.service[61933]: X-Tenant-Id: 684b940d5fdd4a47a9132ae253e07b1c Apr 14 17:42:53 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-TestShelveInstance-1112839499 Apr 14 17:42:53 user devstack@n-api.service[61933]: X-User: tempest-TestShelveInstance-1112839499-project-member Apr 14 17:42:53 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:42:53 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:42:53 user devstack@n-api.service[61933]: X-User-Id: 695d06748c274b01830f3bb9216d3ad8 Apr 14 17:42:53 user devstack@n-api.service[61933]: X-User-Name: tempest-TestShelveInstance-1112839499-project-member Apr 14 17:42:53 user devstack@n-api.service[61933]: method: > Apr 14 17:42:53 user devstack@n-api.service[61933]: exception: Instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 could not be found. Apr 14 17:42:53 user devstack@n-api.service[61933]: action_args: {'id': 'd921bfb3-1d65-44fe-ad66-7821d9fa2959'} Apr 14 17:42:53 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 could not be found. Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 could not be found. Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 could not be found. Apr 14 17:42:53 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:42:53 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-08d9b67a-b541-4128-a2e6-5e0353a396ae tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Returning 404 to user: Instance d921bfb3-1d65-44fe-ad66-7821d9fa2959 could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:42:53 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-08d9b67a-b541-4128-a2e6-5e0353a396ae tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959" status: 404 len: 111 microversion: 2.1 time: 0.038388 Apr 14 17:42:53 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 357/1075] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:42:53 2023] GET /compute/v2.1/servers/d921bfb3-1d65-44fe-ad66-7821d9fa2959 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:42:53 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:42:53 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:42:53 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-4fdfbf3e-82dc-4479-a29d-3a7dbfb6456e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] Calling method '.version_select at 0x7fe19d0f9cf0>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:42:53 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-4fdfbf3e-82dc-4479-a29d-3a7dbfb6456e tempest-TestShelveInstance-1112839499 tempest-TestShelveInstance-1112839499-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-291918457" status: 202 len: 0 microversion: 2.1 time: 0.126086 Apr 14 17:42:53 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 358/1076] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 17:42:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-291918457 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 17:43:21 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:43:21 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:43:21 user devstack@n-api.service[61935]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:43:21 user devstack@n-api.service[61935]: Fri Apr 14 17:43:21 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 14 17:43:21 user devstack@n-api.service[61935]: ERROR oslo.messaging._drivers.impl_rabbit [-] [08b4fb43-252f-49c7-a4f2-e609853ccb81] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 17:43:21 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1351290960", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "e0cad371-83ab-4806-a1ac-78afe5d4d55c", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf"}]}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:43:22 user devstack@n-api.service[61935]: DEBUG nova.network.neutron [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] validate_networks() for [('e0a9bb9b-0523-41d9-a8ea-0c8772015edf', None, None, None, None, None)] {{(pid=61935) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:43:22 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:43:22 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:43:22 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:43:22 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:43:22 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:43:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:43:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:43:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:43:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:43:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:43:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:43:22 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting quotas for project 47e868622506423e80b158e7bf60c561. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:43:22 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting quotas for user f86537c1b58843d399db6cec00012c50 and project 47e868622506423e80b158e7bf60c561. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:43:22 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Going to run 1 instances... {{(pid=61935) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:43:22 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='e0cad371-83ab-4806-a1ac-78afe5d4d55c',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:43:22 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-129cd211-c638-4d1e-a709-354f1d27365b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.851810 Apr 14 17:43:22 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 362/1077] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:43:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:43:22 user devstack@n-api.service[61933]: ERROR oslo.messaging._drivers.impl_rabbit [-] [afd27a4e-5552-43ff-898c-c1fed5e8c593] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 17:43:22 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-989a5a7a-8138-4e4d-a723-1a9e1ec2c102 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:43:22 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-989a5a7a-8138-4e4d-a723-1a9e1ec2c102 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:43:22 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:43:22 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:43:22 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-989a5a7a-8138-4e4d-a723-1a9e1ec2c102 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:43:22 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-989a5a7a-8138-4e4d-a723-1a9e1ec2c102 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406" status: 200 len: 1052 microversion: 2.1 time: 0.102064 Apr 14 17:43:22 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 358/1078] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:43:22 2023] GET /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406 => generated 1052 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 17:43:24 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:43:24 user devstack@n-api.service[61934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:43:24 user devstack@n-api.service[61934]: Fri Apr 14 17:43:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 17:43:24 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-43615f29-05e5-4f60-9bd2-5fc66c7c6f5b req-b2f54176-6abd-4414-aa17-05e89088bca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bdd229d-9e6b-434a-9f05-5b715965d406", "tag": "b4a68cbf-b401-4542-abe2-0fdbe2744a59"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:43:24 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-43615f29-05e5-4f60-9bd2-5fc66c7c6f5b req-b2f54176-6abd-4414-aa17-05e89088bca9 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:43:24 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-43615f29-05e5-4f60-9bd2-5fc66c7c6f5b req-b2f54176-6abd-4414-aa17-05e89088bca9 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:43:24 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-43615f29-05e5-4f60-9bd2-5fc66c7c6f5b req-b2f54176-6abd-4414-aa17-05e89088bca9 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:43:24 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-43615f29-05e5-4f60-9bd2-5fc66c7c6f5b req-b2f54176-6abd-4414-aa17-05e89088bca9 service nova] Creating event network-changed:b4a68cbf-b401-4542-abe2-0fdbe2744a59 for instance 0bdd229d-9e6b-434a-9f05-5b715965d406 on user Apr 14 17:43:24 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-43615f29-05e5-4f60-9bd2-5fc66c7c6f5b req-b2f54176-6abd-4414-aa17-05e89088bca9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044593 Apr 14 17:43:24 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 359/1079] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:43:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:43:36 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:43:36 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:43:36 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:43:36 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:43:36 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-beff476b-231c-48e9-b5e3-200d8a04bfd7 req-a28714e3-d3e8-4b93-89cd-f041563e8e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bdd229d-9e6b-434a-9f05-5b715965d406", "name": "network-vif-plugged", "status": "completed", "tag": "b4a68cbf-b401-4542-abe2-0fdbe2744a59"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:43:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-beff476b-231c-48e9-b5e3-200d8a04bfd7 req-a28714e3-d3e8-4b93-89cd-f041563e8e2b service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:43:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-beff476b-231c-48e9-b5e3-200d8a04bfd7 req-a28714e3-d3e8-4b93-89cd-f041563e8e2b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:43:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-beff476b-231c-48e9-b5e3-200d8a04bfd7 req-a28714e3-d3e8-4b93-89cd-f041563e8e2b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:43:36 user devstack@n-api.service[61935]: INFO oslo.messaging._drivers.impl_rabbit [-] [08b4fb43-252f-49c7-a4f2-e609853ccb81] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 34644. Apr 14 17:43:36 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-beff476b-231c-48e9-b5e3-200d8a04bfd7 req-a28714e3-d3e8-4b93-89cd-f041563e8e2b service nova] Creating event network-vif-plugged:b4a68cbf-b401-4542-abe2-0fdbe2744a59 for instance 0bdd229d-9e6b-434a-9f05-5b715965d406 on user Apr 14 17:43:36 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-beff476b-231c-48e9-b5e3-200d8a04bfd7 req-a28714e3-d3e8-4b93-89cd-f041563e8e2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076550 Apr 14 17:43:36 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 363/1080] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:43:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:43:38 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-296798bc-0903-427a-8373-fe5d9e63dc5d req-5d6a787d-afc4-4b7f-8a2d-e047df2e6d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bdd229d-9e6b-434a-9f05-5b715965d406", "name": "network-vif-plugged", "status": "completed", "tag": "b4a68cbf-b401-4542-abe2-0fdbe2744a59"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:43:38 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:43:38 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:43:38 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-296798bc-0903-427a-8373-fe5d9e63dc5d req-5d6a787d-afc4-4b7f-8a2d-e047df2e6d6a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:43:38 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-296798bc-0903-427a-8373-fe5d9e63dc5d req-5d6a787d-afc4-4b7f-8a2d-e047df2e6d6a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:43:38 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-296798bc-0903-427a-8373-fe5d9e63dc5d req-5d6a787d-afc4-4b7f-8a2d-e047df2e6d6a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:43:38 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-296798bc-0903-427a-8373-fe5d9e63dc5d req-5d6a787d-afc4-4b7f-8a2d-e047df2e6d6a service nova] Creating event network-vif-plugged:b4a68cbf-b401-4542-abe2-0fdbe2744a59 for instance 0bdd229d-9e6b-434a-9f05-5b715965d406 on user Apr 14 17:43:38 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-296798bc-0903-427a-8373-fe5d9e63dc5d req-5d6a787d-afc4-4b7f-8a2d-e047df2e6d6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047192 Apr 14 17:43:38 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 359/1081] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:43:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:44:12 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:44:12 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:44:12 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-cfdca475-c16f-4235-8bc4-0c424a364093 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:44:12 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-cfdca475-c16f-4235-8bc4-0c424a364093 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:44:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-cfdca475-c16f-4235-8bc4-0c424a364093 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:44:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-cfdca475-c16f-4235-8bc4-0c424a364093 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:44:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-cfdca475-c16f-4235-8bc4-0c424a364093 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:44:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-cfdca475-c16f-4235-8bc4-0c424a364093 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:44:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-cfdca475-c16f-4235-8bc4-0c424a364093 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:44:12 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-cfdca475-c16f-4235-8bc4-0c424a364093 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:44:13 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-cfdca475-c16f-4235-8bc4-0c424a364093 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:44:13 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-cfdca475-c16f-4235-8bc4-0c424a364093 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406" status: 200 len: 1378 microversion: 2.1 time: 0.318369 Apr 14 17:44:13 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 360/1082] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:44:12 2023] GET /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406 => generated 1378 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:45:13 user devstack@n-api.service[61935]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:45:13 user devstack@n-api.service[61935]: Fri Apr 14 17:45:13 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406 (ip 10.0.0.210) !!! Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-9951603f-ef3b-4494-b263-b9868145fcab tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-9951603f-ef3b-4494-b263-b9868145fcab tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9951603f-ef3b-4494-b263-b9868145fcab tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9951603f-ef3b-4494-b263-b9868145fcab tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9951603f-ef3b-4494-b263-b9868145fcab tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9951603f-ef3b-4494-b263-b9868145fcab tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9951603f-ef3b-4494-b263-b9868145fcab tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-9951603f-ef3b-4494-b263-b9868145fcab tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-9951603f-ef3b-4494-b263-b9868145fcab tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:45:13 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-9951603f-ef3b-4494-b263-b9868145fcab tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406" status: 200 len: 1378 microversion: 2.1 time: 0.237640 Apr 14 17:45:13 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 364/1083] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:45:13 2023] GET /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406 => generated 1378 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:45:13 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:45:13 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:45:13 user devstack@n-api.service[61933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:45:13 user devstack@n-api.service[61933]: Fri Apr 14 17:45:13 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406 (ip 10.0.0.210) !!! Apr 14 17:45:13 user devstack@n-api.service[61933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:45:13 user devstack@n-api.service[61933]: Fri Apr 14 17:45:13 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406 (ip 10.0.0.210) !!! Apr 14 17:45:13 user devstack@n-api.service[61933]: INFO oslo.messaging._drivers.impl_rabbit [-] [afd27a4e-5552-43ff-898c-c1fed5e8c593] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 34656. Apr 14 17:45:13 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-6920776f-e4f2-4ecc-97fa-61665c4f1d19 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:45:13 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-6920776f-e4f2-4ecc-97fa-61665c4f1d19 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:45:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6920776f-e4f2-4ecc-97fa-61665c4f1d19 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:45:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6920776f-e4f2-4ecc-97fa-61665c4f1d19 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:45:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6920776f-e4f2-4ecc-97fa-61665c4f1d19 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:45:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6920776f-e4f2-4ecc-97fa-61665c4f1d19 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:45:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6920776f-e4f2-4ecc-97fa-61665c4f1d19 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:45:13 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6920776f-e4f2-4ecc-97fa-61665c4f1d19 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:45:13 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-6920776f-e4f2-4ecc-97fa-61665c4f1d19 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:45:13 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-6920776f-e4f2-4ecc-97fa-61665c4f1d19 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406" status: 200 len: 1378 microversion: 2.1 time: 0.237031 Apr 14 17:45:13 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 360/1084] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:45:13 2023] GET /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406 => generated 1378 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:45:13 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:45:13 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:45:13 user devstack@n-api.service[61934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:45:13 user devstack@n-api.service[61934]: Fri Apr 14 17:45:13 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406 (ip 10.0.0.210) !!! Apr 14 17:45:13 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:45:13 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:45:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:45:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:45:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:45:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:45:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:45:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:45:13 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Going to try to terminate instance {{(pid=61934) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:45:13 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-c66f9798-eac1-4e87-8359-232e58a58c3a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406" status: 204 len: 0 microversion: 2.1 time: 0.137235 Apr 14 17:45:13 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 361/1085] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:45:13 2023] DELETE /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-be144da2-1739-4e5c-a603-e1693aa66c48 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-be144da2-1739-4e5c-a603-e1693aa66c48 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-be144da2-1739-4e5c-a603-e1693aa66c48 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-be144da2-1739-4e5c-a603-e1693aa66c48 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-be144da2-1739-4e5c-a603-e1693aa66c48 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-be144da2-1739-4e5c-a603-e1693aa66c48 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-be144da2-1739-4e5c-a603-e1693aa66c48 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:45:13 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-be144da2-1739-4e5c-a603-e1693aa66c48 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:45:14 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-be144da2-1739-4e5c-a603-e1693aa66c48 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:45:14 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-be144da2-1739-4e5c-a603-e1693aa66c48 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406" status: 200 len: 1384 microversion: 2.1 time: 0.169450 Apr 14 17:45:14 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 365/1086] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:45:13 2023] GET /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406 => generated 1384 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:45:14 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-111b4283-73a0-4d3b-ac2a-200984312e5c req-246dd09e-513b-45af-82e8-a1ff00ebcfde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bdd229d-9e6b-434a-9f05-5b715965d406", "name": "network-vif-unplugged", "status": "completed", "tag": "b4a68cbf-b401-4542-abe2-0fdbe2744a59"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:45:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-111b4283-73a0-4d3b-ac2a-200984312e5c req-246dd09e-513b-45af-82e8-a1ff00ebcfde service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:45:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-111b4283-73a0-4d3b-ac2a-200984312e5c req-246dd09e-513b-45af-82e8-a1ff00ebcfde service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:45:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-111b4283-73a0-4d3b-ac2a-200984312e5c req-246dd09e-513b-45af-82e8-a1ff00ebcfde service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:45:14 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-111b4283-73a0-4d3b-ac2a-200984312e5c req-246dd09e-513b-45af-82e8-a1ff00ebcfde service nova] Creating event network-vif-unplugged:b4a68cbf-b401-4542-abe2-0fdbe2744a59 for instance 0bdd229d-9e6b-434a-9f05-5b715965d406 on user Apr 14 17:45:14 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-111b4283-73a0-4d3b-ac2a-200984312e5c req-246dd09e-513b-45af-82e8-a1ff00ebcfde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029104 Apr 14 17:45:14 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 361/1087] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:45:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:45:15 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-5ef2243e-9a4f-40ae-b680-9e5bf95c4136 req-a3cc61c8-a24b-4271-b9a7-1a77da60b7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bdd229d-9e6b-434a-9f05-5b715965d406", "name": "network-vif-deleted", "tag": "b4a68cbf-b401-4542-abe2-0fdbe2744a59"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:45:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5ef2243e-9a4f-40ae-b680-9e5bf95c4136 req-a3cc61c8-a24b-4271-b9a7-1a77da60b7e1 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:45:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5ef2243e-9a4f-40ae-b680-9e5bf95c4136 req-a3cc61c8-a24b-4271-b9a7-1a77da60b7e1 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:45:15 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5ef2243e-9a4f-40ae-b680-9e5bf95c4136 req-a3cc61c8-a24b-4271-b9a7-1a77da60b7e1 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:45:15 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-5ef2243e-9a4f-40ae-b680-9e5bf95c4136 req-a3cc61c8-a24b-4271-b9a7-1a77da60b7e1 service nova] Creating event network-vif-deleted:b4a68cbf-b401-4542-abe2-0fdbe2744a59 for instance 0bdd229d-9e6b-434a-9f05-5b715965d406 on user Apr 14 17:45:15 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-5ef2243e-9a4f-40ae-b680-9e5bf95c4136 req-a3cc61c8-a24b-4271-b9a7-1a77da60b7e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034559 Apr 14 17:45:15 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 362/1088] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:45:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:45:16 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-3a83ceb1-4145-43bd-97f1-c399666b9dc9 req-d0d20346-1af9-4169-8946-db0fbf5e8ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bdd229d-9e6b-434a-9f05-5b715965d406", "name": "network-vif-plugged", "status": "completed", "tag": "b4a68cbf-b401-4542-abe2-0fdbe2744a59"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:45:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3a83ceb1-4145-43bd-97f1-c399666b9dc9 req-d0d20346-1af9-4169-8946-db0fbf5e8ef9 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:45:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3a83ceb1-4145-43bd-97f1-c399666b9dc9 req-d0d20346-1af9-4169-8946-db0fbf5e8ef9 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:45:16 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3a83ceb1-4145-43bd-97f1-c399666b9dc9 req-d0d20346-1af9-4169-8946-db0fbf5e8ef9 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:45:16 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-3a83ceb1-4145-43bd-97f1-c399666b9dc9 req-d0d20346-1af9-4169-8946-db0fbf5e8ef9 service nova] Creating event network-vif-plugged:b4a68cbf-b401-4542-abe2-0fdbe2744a59 for instance 0bdd229d-9e6b-434a-9f05-5b715965d406 on user Apr 14 17:45:16 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-3a83ceb1-4145-43bd-97f1-c399666b9dc9 req-d0d20346-1af9-4169-8946-db0fbf5e8ef9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030518 Apr 14 17:45:16 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 366/1089] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:45:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:46:04 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:46:04 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=8 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:46:04 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-4cff9890-6f3b-4573-bd00-8344c5039c1c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:46:04 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-4cff9890-6f3b-4573-bd00-8344c5039c1c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:46:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4cff9890-6f3b-4573-bd00-8344c5039c1c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:46:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4cff9890-6f3b-4573-bd00-8344c5039c1c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:46:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4cff9890-6f3b-4573-bd00-8344c5039c1c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:46:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4cff9890-6f3b-4573-bd00-8344c5039c1c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:46:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4cff9890-6f3b-4573-bd00-8344c5039c1c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:46:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-4cff9890-6f3b-4573-bd00-8344c5039c1c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:46:04 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-4cff9890-6f3b-4573-bd00-8344c5039c1c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HTTP exception thrown: Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 could not be found. Apr 14 17:46:04 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-4cff9890-6f3b-4573-bd00-8344c5039c1c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Request method failure captured: Apr 14 17:46:04 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406 HTTP/1.1 Apr 14 17:46:04 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:46:04 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:46:04 user devstack@n-api.service[61933]: Connection: close Apr 14 17:46:04 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:46:04 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:46:04 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:46:04 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:46:04 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:46:04 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOZCsNb-viKhmBQ0HTiDifBqh5pX9pTC7XXLbMHQf-psdXdwKMA4ha5ApiLG_rkKgNSVLjM5Js1w69j2ZXhPiTzXOXnuQKiD7xw7W1JnnTHt4G55p3wmQ_mkyhqbIrEl5ejyE-ni76X7010TLMaLpG_vmjlgnfxdI3G4x1tRXanWnagA Apr 14 17:46:04 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:46:04 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:46:04 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:46:04 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:46:04 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:46:04 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:46:04 user devstack@n-api.service[61933]: X-Project-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:46:04 user devstack@n-api.service[61933]: X-Project-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:46:04 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:46:04 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:46:04 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/47e868622506423e80b158e7bf60c561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:46:04 user devstack@n-api.service[61933]: X-Tenant: tempest-TestVolumeBootPattern-725648218 Apr 14 17:46:04 user devstack@n-api.service[61933]: X-Tenant-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:46:04 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:46:04 user devstack@n-api.service[61933]: X-User: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:46:04 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:46:04 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:46:04 user devstack@n-api.service[61933]: X-User-Id: f86537c1b58843d399db6cec00012c50 Apr 14 17:46:04 user devstack@n-api.service[61933]: X-User-Name: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:46:04 user devstack@n-api.service[61933]: method: > Apr 14 17:46:04 user devstack@n-api.service[61933]: exception: Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 could not be found. Apr 14 17:46:04 user devstack@n-api.service[61933]: action_args: {'id': '0bdd229d-9e6b-434a-9f05-5b715965d406'} Apr 14 17:46:04 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 could not be found. Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 could not be found. Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 could not be found. Apr 14 17:46:04 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:46:04 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-4cff9890-6f3b-4573-bd00-8344c5039c1c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Returning 404 to user: Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:46:04 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-4cff9890-6f3b-4573-bd00-8344c5039c1c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406" status: 404 len: 111 microversion: 2.1 time: 0.038690 Apr 14 17:46:04 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 362/1090] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:46:04 2023] GET /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:46:04 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:46:04 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:46:04 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-e7b0cff3-cf83-46ff-8ba0-bbaca888dfaa tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:46:04 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-e7b0cff3-cf83-46ff-8ba0-bbaca888dfaa tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:46:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e7b0cff3-cf83-46ff-8ba0-bbaca888dfaa tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:46:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e7b0cff3-cf83-46ff-8ba0-bbaca888dfaa tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:46:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e7b0cff3-cf83-46ff-8ba0-bbaca888dfaa tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:46:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e7b0cff3-cf83-46ff-8ba0-bbaca888dfaa tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:46:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e7b0cff3-cf83-46ff-8ba0-bbaca888dfaa tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:46:04 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-e7b0cff3-cf83-46ff-8ba0-bbaca888dfaa tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:46:04 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-e7b0cff3-cf83-46ff-8ba0-bbaca888dfaa tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HTTP exception thrown: Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 could not be found. Apr 14 17:46:04 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-e7b0cff3-cf83-46ff-8ba0-bbaca888dfaa tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Request method failure captured: Apr 14 17:46:04 user devstack@n-api.service[61934]: request: DELETE /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406 HTTP/1.1 Apr 14 17:46:04 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:46:04 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:46:04 user devstack@n-api.service[61934]: Connection: close Apr 14 17:46:04 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:46:04 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:46:04 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:46:04 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:46:04 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:46:04 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOZCsNb-viKhmBQ0HTiDifBqh5pX9pTC7XXLbMHQf-psdXdwKMA4ha5ApiLG_rkKgNSVLjM5Js1w69j2ZXhPiTzXOXnuQKiD7xw7W1JnnTHt4G55p3wmQ_mkyhqbIrEl5ejyE-ni76X7010TLMaLpG_vmjlgnfxdI3G4x1tRXanWnagA Apr 14 17:46:04 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:46:04 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:46:04 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:46:04 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:46:04 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:46:04 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:46:04 user devstack@n-api.service[61934]: X-Project-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:46:04 user devstack@n-api.service[61934]: X-Project-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:46:04 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:46:04 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:46:04 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/47e868622506423e80b158e7bf60c561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:46:04 user devstack@n-api.service[61934]: X-Tenant: tempest-TestVolumeBootPattern-725648218 Apr 14 17:46:04 user devstack@n-api.service[61934]: X-Tenant-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:46:04 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:46:04 user devstack@n-api.service[61934]: X-User: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:46:04 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:46:04 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:46:04 user devstack@n-api.service[61934]: X-User-Id: f86537c1b58843d399db6cec00012c50 Apr 14 17:46:04 user devstack@n-api.service[61934]: X-User-Name: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:46:04 user devstack@n-api.service[61934]: method: > Apr 14 17:46:04 user devstack@n-api.service[61934]: exception: Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 could not be found. Apr 14 17:46:04 user devstack@n-api.service[61934]: action_args: {'id': '0bdd229d-9e6b-434a-9f05-5b715965d406'} Apr 14 17:46:04 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 could not be found. Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 could not be found. Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 could not be found. Apr 14 17:46:04 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:46:04 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-e7b0cff3-cf83-46ff-8ba0-bbaca888dfaa tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Returning 404 to user: Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:46:04 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-e7b0cff3-cf83-46ff-8ba0-bbaca888dfaa tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406" status: 404 len: 111 microversion: 2.1 time: 0.037933 Apr 14 17:46:04 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 363/1091] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:46:04 2023] DELETE /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:46:04 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:46:04 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=14 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:46:04 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-4b0deb84-d820-45ed-9e35-8bf3bd3540b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:46:04 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-4b0deb84-d820-45ed-9e35-8bf3bd3540b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 0bdd229d-9e6b-434a-9f05-5b715965d406] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:46:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4b0deb84-d820-45ed-9e35-8bf3bd3540b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:46:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4b0deb84-d820-45ed-9e35-8bf3bd3540b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:46:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4b0deb84-d820-45ed-9e35-8bf3bd3540b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:46:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4b0deb84-d820-45ed-9e35-8bf3bd3540b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:46:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4b0deb84-d820-45ed-9e35-8bf3bd3540b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:46:04 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-4b0deb84-d820-45ed-9e35-8bf3bd3540b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:46:04 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-4b0deb84-d820-45ed-9e35-8bf3bd3540b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HTTP exception thrown: Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 could not be found. Apr 14 17:46:04 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-4b0deb84-d820-45ed-9e35-8bf3bd3540b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Request method failure captured: Apr 14 17:46:04 user devstack@n-api.service[61935]: request: GET /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406 HTTP/1.1 Apr 14 17:46:04 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:46:04 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:46:04 user devstack@n-api.service[61935]: Connection: close Apr 14 17:46:04 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:46:04 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:46:04 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:46:04 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:46:04 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:46:04 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOZCsNb-viKhmBQ0HTiDifBqh5pX9pTC7XXLbMHQf-psdXdwKMA4ha5ApiLG_rkKgNSVLjM5Js1w69j2ZXhPiTzXOXnuQKiD7xw7W1JnnTHt4G55p3wmQ_mkyhqbIrEl5ejyE-ni76X7010TLMaLpG_vmjlgnfxdI3G4x1tRXanWnagA Apr 14 17:46:04 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:46:04 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:46:04 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:46:04 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:46:04 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:46:04 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:46:04 user devstack@n-api.service[61935]: X-Project-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:46:04 user devstack@n-api.service[61935]: X-Project-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:46:04 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:46:04 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:46:04 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/47e868622506423e80b158e7bf60c561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:46:04 user devstack@n-api.service[61935]: X-Tenant: tempest-TestVolumeBootPattern-725648218 Apr 14 17:46:04 user devstack@n-api.service[61935]: X-Tenant-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:46:04 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:46:04 user devstack@n-api.service[61935]: X-User: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:46:04 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:46:04 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:46:04 user devstack@n-api.service[61935]: X-User-Id: f86537c1b58843d399db6cec00012c50 Apr 14 17:46:04 user devstack@n-api.service[61935]: X-User-Name: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:46:04 user devstack@n-api.service[61935]: method: > Apr 14 17:46:04 user devstack@n-api.service[61935]: exception: Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 could not be found. Apr 14 17:46:04 user devstack@n-api.service[61935]: action_args: {'id': '0bdd229d-9e6b-434a-9f05-5b715965d406'} Apr 14 17:46:04 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 could not be found. Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 could not be found. Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 could not be found. Apr 14 17:46:04 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:46:04 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-4b0deb84-d820-45ed-9e35-8bf3bd3540b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Returning 404 to user: Instance 0bdd229d-9e6b-434a-9f05-5b715965d406 could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:46:04 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-4b0deb84-d820-45ed-9e35-8bf3bd3540b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406" status: 404 len: 111 microversion: 2.1 time: 0.036662 Apr 14 17:46:04 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 367/1092] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:46:04 2023] GET /compute/v2.1/servers/0bdd229d-9e6b-434a-9f05-5b715965d406 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:46:14 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1425264582", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "e040b16e-d08b-4341-a869-cc4ee4629f1c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf"}]}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:46:14 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:46:14 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:46:14 user devstack@n-api.service[61933]: DEBUG nova.network.neutron [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] validate_networks() for [('e0a9bb9b-0523-41d9-a8ea-0c8772015edf', None, None, None, None, None)] {{(pid=61933) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:46:14 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:46:14 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:46:14 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:46:14 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:46:14 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:46:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:46:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:46:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:46:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:46:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:46:14 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:46:14 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting quotas for project 47e868622506423e80b158e7bf60c561. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:46:14 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting quotas for user f86537c1b58843d399db6cec00012c50 and project 47e868622506423e80b158e7bf60c561. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:46:15 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Going to run 1 instances... {{(pid=61933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:46:15 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e040b16e-d08b-4341-a869-cc4ee4629f1c',volume_size=None,volume_type=None)] {{(pid=61933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:46:15 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-c5e5afe9-f918-4a6d-879e-9715e5285925 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.757652 Apr 14 17:46:15 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 363/1093] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:46:14 2023] POST /compute/v2.1/servers => generated 378 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:46:15 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-f46dafc2-0260-4739-90df-aceeaa2f1b74 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:46:15 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-f46dafc2-0260-4739-90df-aceeaa2f1b74 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:46:15 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:46:15 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:46:15 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-f46dafc2-0260-4739-90df-aceeaa2f1b74 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:46:15 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-f46dafc2-0260-4739-90df-aceeaa2f1b74 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed" status: 200 len: 1066 microversion: 2.1 time: 0.081825 Apr 14 17:46:15 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 364/1094] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:46:15 2023] GET /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed => generated 1066 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:46:17 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-bd1d3980-0b34-4c2a-99eb-c39fa76c75e4 req-93a01fcd-59e8-4bef-b4d0-2d1c9611918a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcaa9cda-dd0b-4fa2-9820-8941995f22ed", "tag": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:46:17 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:46:17 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:46:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-bd1d3980-0b34-4c2a-99eb-c39fa76c75e4 req-93a01fcd-59e8-4bef-b4d0-2d1c9611918a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:46:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-bd1d3980-0b34-4c2a-99eb-c39fa76c75e4 req-93a01fcd-59e8-4bef-b4d0-2d1c9611918a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:46:17 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-bd1d3980-0b34-4c2a-99eb-c39fa76c75e4 req-93a01fcd-59e8-4bef-b4d0-2d1c9611918a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:46:17 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-bd1d3980-0b34-4c2a-99eb-c39fa76c75e4 req-93a01fcd-59e8-4bef-b4d0-2d1c9611918a service nova] Creating event network-changed:7a8c2b1a-57dd-4e05-b244-3a5b880d5adf for instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed on user Apr 14 17:46:17 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-bd1d3980-0b34-4c2a-99eb-c39fa76c75e4 req-93a01fcd-59e8-4bef-b4d0-2d1c9611918a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033727 Apr 14 17:46:17 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 368/1095] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:46:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:46:23 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-13ee9121-f4d4-42a3-a036-c0ac7008258d req-fa5abb31-cc95-4749-b59e-dd7ddaaf07ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcaa9cda-dd0b-4fa2-9820-8941995f22ed", "name": "network-vif-plugged", "status": "completed", "tag": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:46:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-13ee9121-f4d4-42a3-a036-c0ac7008258d req-fa5abb31-cc95-4749-b59e-dd7ddaaf07ba service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:46:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-13ee9121-f4d4-42a3-a036-c0ac7008258d req-fa5abb31-cc95-4749-b59e-dd7ddaaf07ba service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:46:23 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-13ee9121-f4d4-42a3-a036-c0ac7008258d req-fa5abb31-cc95-4749-b59e-dd7ddaaf07ba service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:46:23 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-13ee9121-f4d4-42a3-a036-c0ac7008258d req-fa5abb31-cc95-4749-b59e-dd7ddaaf07ba service nova] Creating event network-vif-plugged:7a8c2b1a-57dd-4e05-b244-3a5b880d5adf for instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed on user Apr 14 17:46:23 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-13ee9121-f4d4-42a3-a036-c0ac7008258d req-fa5abb31-cc95-4749-b59e-dd7ddaaf07ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094816 Apr 14 17:46:23 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 364/1096] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:46:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:46:25 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-8c31cea6-7f7a-43d2-9f87-a8270749ff85 req-8a0d78a0-7e7c-421a-9f68-f33db7b80a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcaa9cda-dd0b-4fa2-9820-8941995f22ed", "name": "network-vif-plugged", "status": "completed", "tag": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:46:25 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:46:25 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:46:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8c31cea6-7f7a-43d2-9f87-a8270749ff85 req-8a0d78a0-7e7c-421a-9f68-f33db7b80a53 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:46:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8c31cea6-7f7a-43d2-9f87-a8270749ff85 req-8a0d78a0-7e7c-421a-9f68-f33db7b80a53 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:46:25 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-8c31cea6-7f7a-43d2-9f87-a8270749ff85 req-8a0d78a0-7e7c-421a-9f68-f33db7b80a53 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:46:26 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-8c31cea6-7f7a-43d2-9f87-a8270749ff85 req-8a0d78a0-7e7c-421a-9f68-f33db7b80a53 service nova] Creating event network-vif-plugged:7a8c2b1a-57dd-4e05-b244-3a5b880d5adf for instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed on user Apr 14 17:46:26 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-8c31cea6-7f7a-43d2-9f87-a8270749ff85 req-8a0d78a0-7e7c-421a-9f68-f33db7b80a53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039149 Apr 14 17:46:26 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 365/1097] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:46:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:47:05 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:47:05 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:47:05 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-5ba84ab2-d4a8-4064-b4f9-880758c82ad9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:47:05 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-5ba84ab2-d4a8-4064-b4f9-880758c82ad9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:47:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5ba84ab2-d4a8-4064-b4f9-880758c82ad9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:47:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5ba84ab2-d4a8-4064-b4f9-880758c82ad9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:47:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5ba84ab2-d4a8-4064-b4f9-880758c82ad9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:47:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5ba84ab2-d4a8-4064-b4f9-880758c82ad9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:47:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5ba84ab2-d4a8-4064-b4f9-880758c82ad9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:47:05 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-5ba84ab2-d4a8-4064-b4f9-880758c82ad9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:47:05 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-5ba84ab2-d4a8-4064-b4f9-880758c82ad9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:47:05 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-5ba84ab2-d4a8-4064-b4f9-880758c82ad9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed" status: 200 len: 1392 microversion: 2.1 time: 0.214086 Apr 14 17:47:05 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 369/1098] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:47:05 2023] GET /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed => generated 1392 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:48:05 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:48:05 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:48:05 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:48:05 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:48:05 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-15cac23c-2365-4f77-a3be-5992f9dc689e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:48:05 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-15cac23c-2365-4f77-a3be-5992f9dc689e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:48:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-15cac23c-2365-4f77-a3be-5992f9dc689e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:48:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-15cac23c-2365-4f77-a3be-5992f9dc689e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:48:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-15cac23c-2365-4f77-a3be-5992f9dc689e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:48:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-15cac23c-2365-4f77-a3be-5992f9dc689e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:48:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-15cac23c-2365-4f77-a3be-5992f9dc689e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:48:05 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-15cac23c-2365-4f77-a3be-5992f9dc689e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:48:05 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-15cac23c-2365-4f77-a3be-5992f9dc689e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:48:05 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-15cac23c-2365-4f77-a3be-5992f9dc689e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed" status: 200 len: 1392 microversion: 2.1 time: 0.345329 Apr 14 17:48:05 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 365/1099] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:48:05 2023] GET /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed => generated 1392 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:48:05 user devstack@n-api.service[61934]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f9c1eadf-1445-413a-a06d-1e6fd2e4b8ab] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 17:48:05 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:48:05 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:48:05 user devstack@n-api.service[61934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:48:05 user devstack@n-api.service[61934]: Fri Apr 14 17:48:05 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed/action (ip 10.0.0.210) !!! Apr 14 17:48:05 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-63e18dbc-8515-4d03-88a7-d98d994fdcb9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1824097949"}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:48:05 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-63e18dbc-8515-4d03-88a7-d98d994fdcb9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:48:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-63e18dbc-8515-4d03-88a7-d98d994fdcb9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:48:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-63e18dbc-8515-4d03-88a7-d98d994fdcb9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:48:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-63e18dbc-8515-4d03-88a7-d98d994fdcb9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:48:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-63e18dbc-8515-4d03-88a7-d98d994fdcb9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:48:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-63e18dbc-8515-4d03-88a7-d98d994fdcb9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:48:05 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-63e18dbc-8515-4d03-88a7-d98d994fdcb9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:48:06 user devstack@n-api.service[61934]: INFO nova.compute.api [None req-63e18dbc-8515-4d03-88a7-d98d994fdcb9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Attempting to quiesce instance before volume snapshot. Apr 14 17:48:06 user devstack@n-api.service[61934]: INFO oslo.messaging._drivers.impl_rabbit [-] [f9c1eadf-1445-413a-a06d-1e6fd2e4b8ab] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 59432. Apr 14 17:48:06 user devstack@n-api.service[61934]: INFO nova.compute.api [None req-63e18dbc-8515-4d03-88a7-d98d994fdcb9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 14 17:48:07 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-63e18dbc-8515-4d03-88a7-d98d994fdcb9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Creating snapshot from volume e040b16e-d08b-4341-a869-cc4ee4629f1c. {{(pid=61934) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 14 17:48:09 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-63e18dbc-8515-4d03-88a7-d98d994fdcb9 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed/action" status: 202 len: 0 microversion: 2.1 time: 3.309721 Apr 14 17:48:09 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 366/1100] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 17:48:05 2023] POST /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed/action => generated 0 bytes in 3313 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 17:48:10 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:48:10 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:48:10 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1785581967", "imageRef": "004b3625-95b1-4d74-8dc1-6e6c69ffff94", "flavorRef": "42", "networks": [{"uuid": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf"}]}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:48:10 user devstack@n-api.service[61935]: DEBUG nova.network.neutron [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] validate_networks() for [('e0a9bb9b-0523-41d9-a8ea-0c8772015edf', None, None, None, None, None)] {{(pid=61935) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:48:10 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:48:10 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:48:10 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:48:10 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:48:10 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:48:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:48:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:48:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:48:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:48:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:48:10 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:48:10 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting quotas for project 47e868622506423e80b158e7bf60c561. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:48:11 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting quotas for user f86537c1b58843d399db6cec00012c50 and project 47e868622506423e80b158e7bf60c561. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:48:11 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Going to run 1 instances... {{(pid=61935) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:48:11 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='bab3abf8-5ff2-442b-b50f-525a3ce4d34d',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:48:11 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-60c7354e-e79b-4f12-9ec4-2a699fea79b2 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.668025 Apr 14 17:48:11 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 370/1101] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:48:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:48:11 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-0eab91e0-d6ce-4825-a716-fad00e27660f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:48:11 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-0eab91e0-d6ce-4825-a716-fad00e27660f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:48:11 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-0eab91e0-d6ce-4825-a716-fad00e27660f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:48:11 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-0eab91e0-d6ce-4825-a716-fad00e27660f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775" status: 200 len: 1224 microversion: 2.1 time: 0.067542 Apr 14 17:48:11 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 366/1102] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:48:11 2023] GET /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775 => generated 1224 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:48:13 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-95929732-2c7c-40bf-885f-ea592a14787c req-995e71bd-766f-487e-bff6-388c264087f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "413746e7-f044-4604-9ed8-be8af08de775", "tag": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:48:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-95929732-2c7c-40bf-885f-ea592a14787c req-995e71bd-766f-487e-bff6-388c264087f2 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:48:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-95929732-2c7c-40bf-885f-ea592a14787c req-995e71bd-766f-487e-bff6-388c264087f2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:48:13 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-95929732-2c7c-40bf-885f-ea592a14787c req-995e71bd-766f-487e-bff6-388c264087f2 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:48:13 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-95929732-2c7c-40bf-885f-ea592a14787c req-995e71bd-766f-487e-bff6-388c264087f2 service nova] Creating event network-changed:fe473fa7-c36d-4db1-a628-aeceb4d6e82e for instance 413746e7-f044-4604-9ed8-be8af08de775 on user Apr 14 17:48:13 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-95929732-2c7c-40bf-885f-ea592a14787c req-995e71bd-766f-487e-bff6-388c264087f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141295 Apr 14 17:48:13 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 367/1103] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:48:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:48:25 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:48:25 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:48:25 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:48:25 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:48:25 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-15dd3605-6e98-472b-93bc-936a3ff9e2e2 req-eab8aa15-2481-4d89-b3b5-1c2e52b43c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413746e7-f044-4604-9ed8-be8af08de775", "name": "network-vif-plugged", "status": "completed", "tag": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:48:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-15dd3605-6e98-472b-93bc-936a3ff9e2e2 req-eab8aa15-2481-4d89-b3b5-1c2e52b43c80 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:48:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-15dd3605-6e98-472b-93bc-936a3ff9e2e2 req-eab8aa15-2481-4d89-b3b5-1c2e52b43c80 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:48:25 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-15dd3605-6e98-472b-93bc-936a3ff9e2e2 req-eab8aa15-2481-4d89-b3b5-1c2e52b43c80 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:48:25 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-15dd3605-6e98-472b-93bc-936a3ff9e2e2 req-eab8aa15-2481-4d89-b3b5-1c2e52b43c80 service nova] Creating event network-vif-plugged:fe473fa7-c36d-4db1-a628-aeceb4d6e82e for instance 413746e7-f044-4604-9ed8-be8af08de775 on user Apr 14 17:48:25 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-15dd3605-6e98-472b-93bc-936a3ff9e2e2 req-eab8aa15-2481-4d89-b3b5-1c2e52b43c80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055338 Apr 14 17:48:25 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 371/1104] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:48:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:48:27 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-a33d79a8-80e8-4b13-bc18-3cb4a57c8674 req-3ba19622-0c8c-41b0-af37-bb57350d7189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413746e7-f044-4604-9ed8-be8af08de775", "name": "network-vif-plugged", "status": "completed", "tag": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:48:27 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:48:27 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:48:27 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:48:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-a33d79a8-80e8-4b13-bc18-3cb4a57c8674 req-3ba19622-0c8c-41b0-af37-bb57350d7189 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:48:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-a33d79a8-80e8-4b13-bc18-3cb4a57c8674 req-3ba19622-0c8c-41b0-af37-bb57350d7189 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:48:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-a33d79a8-80e8-4b13-bc18-3cb4a57c8674 req-3ba19622-0c8c-41b0-af37-bb57350d7189 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:48:27 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-a33d79a8-80e8-4b13-bc18-3cb4a57c8674 req-3ba19622-0c8c-41b0-af37-bb57350d7189 service nova] Creating event network-vif-plugged:fe473fa7-c36d-4db1-a628-aeceb4d6e82e for instance 413746e7-f044-4604-9ed8-be8af08de775 on user Apr 14 17:48:27 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-a33d79a8-80e8-4b13-bc18-3cb4a57c8674 req-3ba19622-0c8c-41b0-af37-bb57350d7189 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094895 Apr 14 17:48:27 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 367/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:48:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:49:01 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:49:01 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=16,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:49:01 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a57a1262-634e-42a8-a9bd-282ed9c62a2d tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:49:01 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-a57a1262-634e-42a8-a9bd-282ed9c62a2d tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:49:01 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a57a1262-634e-42a8-a9bd-282ed9c62a2d tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:49:01 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a57a1262-634e-42a8-a9bd-282ed9c62a2d tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:49:01 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a57a1262-634e-42a8-a9bd-282ed9c62a2d tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:49:01 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a57a1262-634e-42a8-a9bd-282ed9c62a2d tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:49:01 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a57a1262-634e-42a8-a9bd-282ed9c62a2d tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:49:01 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a57a1262-634e-42a8-a9bd-282ed9c62a2d tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:49:01 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-a57a1262-634e-42a8-a9bd-282ed9c62a2d tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:49:01 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-a57a1262-634e-42a8-a9bd-282ed9c62a2d tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775" status: 200 len: 1551 microversion: 2.1 time: 0.263180 Apr 14 17:49:01 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 368/1106] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:49:01 2023] GET /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775 => generated 1551 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:50:01 user devstack@n-api.service[61935]: ERROR oslo.messaging._drivers.impl_rabbit [-] [08b4fb43-252f-49c7-a4f2-e609853ccb81] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 17:50:01 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:50:01 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:50:01 user devstack@n-api.service[61935]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:50:01 user devstack@n-api.service[61935]: Fri Apr 14 17:50:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775 (ip 10.0.0.210) !!! Apr 14 17:50:01 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-880eb33c-eb28-48f2-8dc6-9e16180b5fa7 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:50:01 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-880eb33c-eb28-48f2-8dc6-9e16180b5fa7 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:50:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-880eb33c-eb28-48f2-8dc6-9e16180b5fa7 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:50:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-880eb33c-eb28-48f2-8dc6-9e16180b5fa7 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:50:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-880eb33c-eb28-48f2-8dc6-9e16180b5fa7 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:50:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-880eb33c-eb28-48f2-8dc6-9e16180b5fa7 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:50:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-880eb33c-eb28-48f2-8dc6-9e16180b5fa7 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:50:01 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-880eb33c-eb28-48f2-8dc6-9e16180b5fa7 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:50:01 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-880eb33c-eb28-48f2-8dc6-9e16180b5fa7 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:50:01 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-880eb33c-eb28-48f2-8dc6-9e16180b5fa7 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775" status: 200 len: 1551 microversion: 2.1 time: 0.296740 Apr 14 17:50:01 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 372/1107] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:50:01 2023] GET /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775 => generated 1551 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:50:01 user devstack@n-api.service[61933]: ERROR oslo.messaging._drivers.impl_rabbit [-] [afd27a4e-5552-43ff-898c-c1fed5e8c593] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 17:50:01 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:50:01 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:50:01 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:50:01 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:50:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:50:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:50:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:50:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:50:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:50:01 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:50:01 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Going to try to terminate instance {{(pid=61933) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:50:02 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-d738b121-66f6-46fe-874d-3111aff88a5e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775" status: 204 len: 0 microversion: 2.1 time: 0.136002 Apr 14 17:50:02 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 368/1108] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:50:01 2023] DELETE /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:50:02 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:50:02 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:50:02 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-d0d0649d-24be-4a94-9aab-922d34aeff22 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:50:02 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-d0d0649d-24be-4a94-9aab-922d34aeff22 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:50:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d0d0649d-24be-4a94-9aab-922d34aeff22 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:50:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d0d0649d-24be-4a94-9aab-922d34aeff22 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:50:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d0d0649d-24be-4a94-9aab-922d34aeff22 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:50:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d0d0649d-24be-4a94-9aab-922d34aeff22 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:50:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d0d0649d-24be-4a94-9aab-922d34aeff22 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:50:02 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-d0d0649d-24be-4a94-9aab-922d34aeff22 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:50:02 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-d0d0649d-24be-4a94-9aab-922d34aeff22 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:50:02 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-d0d0649d-24be-4a94-9aab-922d34aeff22 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775" status: 200 len: 1557 microversion: 2.1 time: 0.220128 Apr 14 17:50:02 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 369/1109] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:50:02 2023] GET /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775 => generated 1557 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:50:02 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-3a87396c-006a-4162-8363-c00f3273e07c req-564631ea-7136-4371-92db-a8d714ab1553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413746e7-f044-4604-9ed8-be8af08de775", "name": "network-vif-unplugged", "status": "completed", "tag": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:50:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3a87396c-006a-4162-8363-c00f3273e07c req-564631ea-7136-4371-92db-a8d714ab1553 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:50:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3a87396c-006a-4162-8363-c00f3273e07c req-564631ea-7136-4371-92db-a8d714ab1553 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:50:02 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-3a87396c-006a-4162-8363-c00f3273e07c req-564631ea-7136-4371-92db-a8d714ab1553 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:50:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-3a87396c-006a-4162-8363-c00f3273e07c req-564631ea-7136-4371-92db-a8d714ab1553 service nova] Creating event network-vif-unplugged:fe473fa7-c36d-4db1-a628-aeceb4d6e82e for instance 413746e7-f044-4604-9ed8-be8af08de775 on user Apr 14 17:50:02 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-3a87396c-006a-4162-8363-c00f3273e07c req-564631ea-7136-4371-92db-a8d714ab1553 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031510 Apr 14 17:50:02 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 373/1110] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:50:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:50:04 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-dfc17d32-3811-4bbd-a2a3-4cc407d6b1f5 req-9fb9be87-0107-4468-ad50-fb45168df1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413746e7-f044-4604-9ed8-be8af08de775", "name": "network-vif-plugged", "status": "completed", "tag": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e"}, {"server_uuid": "413746e7-f044-4604-9ed8-be8af08de775", "name": "network-vif-deleted", "tag": "fe473fa7-c36d-4db1-a628-aeceb4d6e82e"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:50:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-dfc17d32-3811-4bbd-a2a3-4cc407d6b1f5 req-9fb9be87-0107-4468-ad50-fb45168df1c3 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:50:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-dfc17d32-3811-4bbd-a2a3-4cc407d6b1f5 req-9fb9be87-0107-4468-ad50-fb45168df1c3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:50:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-dfc17d32-3811-4bbd-a2a3-4cc407d6b1f5 req-9fb9be87-0107-4468-ad50-fb45168df1c3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:50:04 user devstack@n-api.service[61933]: INFO oslo.messaging._drivers.impl_rabbit [-] [afd27a4e-5552-43ff-898c-c1fed5e8c593] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 37832. Apr 14 17:50:04 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-dfc17d32-3811-4bbd-a2a3-4cc407d6b1f5 req-9fb9be87-0107-4468-ad50-fb45168df1c3 service nova] Creating event network-vif-plugged:fe473fa7-c36d-4db1-a628-aeceb4d6e82e for instance 413746e7-f044-4604-9ed8-be8af08de775 on user Apr 14 17:50:04 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-dfc17d32-3811-4bbd-a2a3-4cc407d6b1f5 req-9fb9be87-0107-4468-ad50-fb45168df1c3 service nova] Creating event network-vif-deleted:fe473fa7-c36d-4db1-a628-aeceb4d6e82e for instance 413746e7-f044-4604-9ed8-be8af08de775 on user Apr 14 17:50:04 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-dfc17d32-3811-4bbd-a2a3-4cc407d6b1f5 req-9fb9be87-0107-4468-ad50-fb45168df1c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034648 Apr 14 17:50:04 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 369/1111] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:50:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:50:52 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:50:52 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:50:52 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-6d1a2359-f19e-44da-b3e5-290131c4ae82 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:50:52 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-6d1a2359-f19e-44da-b3e5-290131c4ae82 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:50:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6d1a2359-f19e-44da-b3e5-290131c4ae82 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:50:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6d1a2359-f19e-44da-b3e5-290131c4ae82 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:50:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6d1a2359-f19e-44da-b3e5-290131c4ae82 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:50:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6d1a2359-f19e-44da-b3e5-290131c4ae82 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:50:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6d1a2359-f19e-44da-b3e5-290131c4ae82 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:50:52 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-6d1a2359-f19e-44da-b3e5-290131c4ae82 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:50:52 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-6d1a2359-f19e-44da-b3e5-290131c4ae82 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HTTP exception thrown: Instance 413746e7-f044-4604-9ed8-be8af08de775 could not be found. Apr 14 17:50:52 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-6d1a2359-f19e-44da-b3e5-290131c4ae82 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Request method failure captured: Apr 14 17:50:52 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775 HTTP/1.1 Apr 14 17:50:52 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:50:52 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:50:52 user devstack@n-api.service[61934]: Connection: close Apr 14 17:50:52 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:50:52 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:50:52 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:50:52 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:50:52 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:50:52 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOZCsNb-viKhmBQ0HTiDifBqh5pX9pTC7XXLbMHQf-psdXdwKMA4ha5ApiLG_rkKgNSVLjM5Js1w69j2ZXhPiTzXOXnuQKiD7xw7W1JnnTHt4G55p3wmQ_mkyhqbIrEl5ejyE-ni76X7010TLMaLpG_vmjlgnfxdI3G4x1tRXanWnagA Apr 14 17:50:52 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:50:52 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:50:52 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:50:52 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:50:52 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:50:52 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:50:52 user devstack@n-api.service[61934]: X-Project-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:50:52 user devstack@n-api.service[61934]: X-Project-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:50:52 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:50:52 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:50:52 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/47e868622506423e80b158e7bf60c561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:50:52 user devstack@n-api.service[61934]: X-Tenant: tempest-TestVolumeBootPattern-725648218 Apr 14 17:50:52 user devstack@n-api.service[61934]: X-Tenant-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:50:52 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:50:52 user devstack@n-api.service[61934]: X-User: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:50:52 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:50:52 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:50:52 user devstack@n-api.service[61934]: X-User-Id: f86537c1b58843d399db6cec00012c50 Apr 14 17:50:52 user devstack@n-api.service[61934]: X-User-Name: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:50:52 user devstack@n-api.service[61934]: method: > Apr 14 17:50:52 user devstack@n-api.service[61934]: exception: Instance 413746e7-f044-4604-9ed8-be8af08de775 could not be found. Apr 14 17:50:52 user devstack@n-api.service[61934]: action_args: {'id': '413746e7-f044-4604-9ed8-be8af08de775'} Apr 14 17:50:52 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 413746e7-f044-4604-9ed8-be8af08de775 could not be found. Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 413746e7-f044-4604-9ed8-be8af08de775 could not be found. Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 413746e7-f044-4604-9ed8-be8af08de775 could not be found. Apr 14 17:50:52 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:50:52 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-6d1a2359-f19e-44da-b3e5-290131c4ae82 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Returning 404 to user: Instance 413746e7-f044-4604-9ed8-be8af08de775 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:50:52 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-6d1a2359-f19e-44da-b3e5-290131c4ae82 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775" status: 404 len: 111 microversion: 2.1 time: 0.032248 Apr 14 17:50:52 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 370/1112] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:50:52 2023] GET /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:50:55 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:50:55 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=8 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:50:55 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:50:55 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:50:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:50:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:50:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:50:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:50:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:50:55 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:50:55 user devstack@n-api.service[61935]: INFO oslo.messaging._drivers.impl_rabbit [-] [08b4fb43-252f-49c7-a4f2-e609853ccb81] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 34102. Apr 14 17:50:55 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Going to try to terminate instance {{(pid=61935) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:50:55 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-3124afe2-ca4d-40b2-aafc-b2146584d8f8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed" status: 204 len: 0 microversion: 2.1 time: 0.120904 Apr 14 17:50:55 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 374/1113] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:50:55 2023] DELETE /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:50:55 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:50:55 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:50:55 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-9259d909-85cf-4001-8e5c-ae9fb445f327 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:50:55 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-9259d909-85cf-4001-8e5c-ae9fb445f327 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:50:55 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9259d909-85cf-4001-8e5c-ae9fb445f327 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:50:55 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9259d909-85cf-4001-8e5c-ae9fb445f327 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:50:55 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9259d909-85cf-4001-8e5c-ae9fb445f327 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:50:55 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9259d909-85cf-4001-8e5c-ae9fb445f327 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:50:55 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9259d909-85cf-4001-8e5c-ae9fb445f327 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:50:55 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9259d909-85cf-4001-8e5c-ae9fb445f327 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:50:55 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-71c022b5-a83f-4123-a384-7f13bd486cbd req-bfbee769-f608-4cd9-a3e5-9d534d810f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcaa9cda-dd0b-4fa2-9820-8941995f22ed", "name": "network-vif-unplugged", "status": "completed", "tag": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:50:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-71c022b5-a83f-4123-a384-7f13bd486cbd req-bfbee769-f608-4cd9-a3e5-9d534d810f43 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:50:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-71c022b5-a83f-4123-a384-7f13bd486cbd req-bfbee769-f608-4cd9-a3e5-9d534d810f43 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:50:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-71c022b5-a83f-4123-a384-7f13bd486cbd req-bfbee769-f608-4cd9-a3e5-9d534d810f43 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:50:55 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-71c022b5-a83f-4123-a384-7f13bd486cbd req-bfbee769-f608-4cd9-a3e5-9d534d810f43 service nova] Creating event network-vif-unplugged:7a8c2b1a-57dd-4e05-b244-3a5b880d5adf for instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed on user Apr 14 17:50:55 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-71c022b5-a83f-4123-a384-7f13bd486cbd req-bfbee769-f608-4cd9-a3e5-9d534d810f43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036192 Apr 14 17:50:55 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 371/1114] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:50:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:50:56 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-9259d909-85cf-4001-8e5c-ae9fb445f327 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:50:56 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-9259d909-85cf-4001-8e5c-ae9fb445f327 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed" status: 200 len: 1398 microversion: 2.1 time: 0.636291 Apr 14 17:50:56 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 370/1115] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:50:55 2023] GET /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed => generated 1398 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:50:57 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-532b8faf-2332-4616-8168-328056f38704 req-ec8ea7e8-e254-489c-90f1-4bb0b5e18aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcaa9cda-dd0b-4fa2-9820-8941995f22ed", "name": "network-vif-deleted", "tag": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:50:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-532b8faf-2332-4616-8168-328056f38704 req-ec8ea7e8-e254-489c-90f1-4bb0b5e18aaf service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:50:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-532b8faf-2332-4616-8168-328056f38704 req-ec8ea7e8-e254-489c-90f1-4bb0b5e18aaf service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:50:57 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-532b8faf-2332-4616-8168-328056f38704 req-ec8ea7e8-e254-489c-90f1-4bb0b5e18aaf service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:50:57 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-532b8faf-2332-4616-8168-328056f38704 req-ec8ea7e8-e254-489c-90f1-4bb0b5e18aaf service nova] Creating event network-vif-deleted:7a8c2b1a-57dd-4e05-b244-3a5b880d5adf for instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed on user Apr 14 17:50:57 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-532b8faf-2332-4616-8168-328056f38704 req-ec8ea7e8-e254-489c-90f1-4bb0b5e18aaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033717 Apr 14 17:50:57 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 375/1116] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:50:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:50:58 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcaa9cda-dd0b-4fa2-9820-8941995f22ed", "name": "network-vif-plugged", "status": "completed", "tag": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf"}, {"server_uuid": "bcaa9cda-dd0b-4fa2-9820-8941995f22ed", "name": "network-vif-plugged", "status": "completed", "tag": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf"}, {"server_uuid": "bcaa9cda-dd0b-4fa2-9820-8941995f22ed", "name": "network-vif-plugged", "status": "completed", "tag": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf"}, {"server_uuid": "bcaa9cda-dd0b-4fa2-9820-8941995f22ed", "name": "network-vif-unplugged", "status": "completed", "tag": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf"}, {"server_uuid": "bcaa9cda-dd0b-4fa2-9820-8941995f22ed", "name": "network-vif-plugged", "status": "completed", "tag": "7a8c2b1a-57dd-4e05-b244-3a5b880d5adf"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:50:58 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:50:58 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:50:58 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:50:58 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Creating event network-vif-plugged:7a8c2b1a-57dd-4e05-b244-3a5b880d5adf for instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed on user Apr 14 17:50:58 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Creating event network-vif-plugged:7a8c2b1a-57dd-4e05-b244-3a5b880d5adf for instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed on user Apr 14 17:50:58 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Creating event network-vif-plugged:7a8c2b1a-57dd-4e05-b244-3a5b880d5adf for instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed on user Apr 14 17:50:58 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Creating event network-vif-unplugged:7a8c2b1a-57dd-4e05-b244-3a5b880d5adf for instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed on user Apr 14 17:50:58 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] Creating event network-vif-plugged:7a8c2b1a-57dd-4e05-b244-3a5b880d5adf for instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed on user Apr 14 17:50:58 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-1c6c177a-9523-4f0d-a5b9-0d1c34872b55 req-c257dfbf-c27e-422c-a05f-b497b4360d2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.038290 Apr 14 17:50:58 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 372/1117] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:50:58 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-a07612eb-d470-49ff-b095-a067cb7611b8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-a07612eb-d470-49ff-b095-a067cb7611b8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-a07612eb-d470-49ff-b095-a067cb7611b8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-a07612eb-d470-49ff-b095-a067cb7611b8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-a07612eb-d470-49ff-b095-a067cb7611b8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-a07612eb-d470-49ff-b095-a067cb7611b8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-a07612eb-d470-49ff-b095-a067cb7611b8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-a07612eb-d470-49ff-b095-a067cb7611b8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:51:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-a07612eb-d470-49ff-b095-a067cb7611b8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HTTP exception thrown: Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed could not be found. Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-a07612eb-d470-49ff-b095-a067cb7611b8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Request method failure captured: Apr 14 17:51:46 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed HTTP/1.1 Apr 14 17:51:46 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:51:46 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:51:46 user devstack@n-api.service[61933]: Connection: close Apr 14 17:51:46 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:51:46 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:51:46 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:51:46 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:51:46 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOZCsNb-viKhmBQ0HTiDifBqh5pX9pTC7XXLbMHQf-psdXdwKMA4ha5ApiLG_rkKgNSVLjM5Js1w69j2ZXhPiTzXOXnuQKiD7xw7W1JnnTHt4G55p3wmQ_mkyhqbIrEl5ejyE-ni76X7010TLMaLpG_vmjlgnfxdI3G4x1tRXanWnagA Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Project-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Project-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/47e868622506423e80b158e7bf60c561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Tenant: tempest-TestVolumeBootPattern-725648218 Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Tenant-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:51:46 user devstack@n-api.service[61933]: X-User: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:51:46 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:51:46 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:51:46 user devstack@n-api.service[61933]: X-User-Id: f86537c1b58843d399db6cec00012c50 Apr 14 17:51:46 user devstack@n-api.service[61933]: X-User-Name: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:51:46 user devstack@n-api.service[61933]: method: > Apr 14 17:51:46 user devstack@n-api.service[61933]: exception: Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed could not be found. Apr 14 17:51:46 user devstack@n-api.service[61933]: action_args: {'id': 'bcaa9cda-dd0b-4fa2-9820-8941995f22ed'} Apr 14 17:51:46 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed could not be found. Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed could not be found. Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed could not be found. Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-a07612eb-d470-49ff-b095-a067cb7611b8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Returning 404 to user: Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:51:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-a07612eb-d470-49ff-b095-a067cb7611b8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed" status: 404 len: 111 microversion: 2.1 time: 0.034577 Apr 14 17:51:46 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 371/1118] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:51:46 2023] GET /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-f1eccf2c-0772-41c0-9fd2-669cc8507f6b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-f1eccf2c-0772-41c0-9fd2-669cc8507f6b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f1eccf2c-0772-41c0-9fd2-669cc8507f6b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f1eccf2c-0772-41c0-9fd2-669cc8507f6b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f1eccf2c-0772-41c0-9fd2-669cc8507f6b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f1eccf2c-0772-41c0-9fd2-669cc8507f6b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f1eccf2c-0772-41c0-9fd2-669cc8507f6b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-f1eccf2c-0772-41c0-9fd2-669cc8507f6b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:51:46 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-f1eccf2c-0772-41c0-9fd2-669cc8507f6b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HTTP exception thrown: Instance 413746e7-f044-4604-9ed8-be8af08de775 could not be found. Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-f1eccf2c-0772-41c0-9fd2-669cc8507f6b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Request method failure captured: Apr 14 17:51:46 user devstack@n-api.service[61935]: request: DELETE /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775 HTTP/1.1 Apr 14 17:51:46 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:51:46 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:51:46 user devstack@n-api.service[61935]: Connection: close Apr 14 17:51:46 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:51:46 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:51:46 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:51:46 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:51:46 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOZCsNb-viKhmBQ0HTiDifBqh5pX9pTC7XXLbMHQf-psdXdwKMA4ha5ApiLG_rkKgNSVLjM5Js1w69j2ZXhPiTzXOXnuQKiD7xw7W1JnnTHt4G55p3wmQ_mkyhqbIrEl5ejyE-ni76X7010TLMaLpG_vmjlgnfxdI3G4x1tRXanWnagA Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Project-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Project-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/47e868622506423e80b158e7bf60c561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Tenant: tempest-TestVolumeBootPattern-725648218 Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Tenant-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:51:46 user devstack@n-api.service[61935]: X-User: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:51:46 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:51:46 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:51:46 user devstack@n-api.service[61935]: X-User-Id: f86537c1b58843d399db6cec00012c50 Apr 14 17:51:46 user devstack@n-api.service[61935]: X-User-Name: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:51:46 user devstack@n-api.service[61935]: method: > Apr 14 17:51:46 user devstack@n-api.service[61935]: exception: Instance 413746e7-f044-4604-9ed8-be8af08de775 could not be found. Apr 14 17:51:46 user devstack@n-api.service[61935]: action_args: {'id': '413746e7-f044-4604-9ed8-be8af08de775'} Apr 14 17:51:46 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 413746e7-f044-4604-9ed8-be8af08de775 could not be found. Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 413746e7-f044-4604-9ed8-be8af08de775 could not be found. Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 413746e7-f044-4604-9ed8-be8af08de775 could not be found. Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-f1eccf2c-0772-41c0-9fd2-669cc8507f6b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Returning 404 to user: Instance 413746e7-f044-4604-9ed8-be8af08de775 could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:51:46 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-f1eccf2c-0772-41c0-9fd2-669cc8507f6b tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775" status: 404 len: 111 microversion: 2.1 time: 0.037180 Apr 14 17:51:46 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 376/1119] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:51:46 2023] DELETE /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:51:46 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:51:46 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:51:46 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-932abd6e-f725-46be-abad-4ed7df104e8a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:51:46 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-932abd6e-f725-46be-abad-4ed7df104e8a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 413746e7-f044-4604-9ed8-be8af08de775] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:51:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-932abd6e-f725-46be-abad-4ed7df104e8a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:51:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-932abd6e-f725-46be-abad-4ed7df104e8a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:51:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-932abd6e-f725-46be-abad-4ed7df104e8a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:51:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-932abd6e-f725-46be-abad-4ed7df104e8a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:51:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-932abd6e-f725-46be-abad-4ed7df104e8a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:51:46 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-932abd6e-f725-46be-abad-4ed7df104e8a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:51:46 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-932abd6e-f725-46be-abad-4ed7df104e8a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HTTP exception thrown: Instance 413746e7-f044-4604-9ed8-be8af08de775 could not be found. Apr 14 17:51:46 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-932abd6e-f725-46be-abad-4ed7df104e8a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Request method failure captured: Apr 14 17:51:46 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775 HTTP/1.1 Apr 14 17:51:46 user devstack@n-api.service[61934]: Accept: application/json Apr 14 17:51:46 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 17:51:46 user devstack@n-api.service[61934]: Connection: close Apr 14 17:51:46 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 17:51:46 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 17:51:46 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 17:51:46 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 17:51:46 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 17:51:46 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOZCsNb-viKhmBQ0HTiDifBqh5pX9pTC7XXLbMHQf-psdXdwKMA4ha5ApiLG_rkKgNSVLjM5Js1w69j2ZXhPiTzXOXnuQKiD7xw7W1JnnTHt4G55p3wmQ_mkyhqbIrEl5ejyE-ni76X7010TLMaLpG_vmjlgnfxdI3G4x1tRXanWnagA Apr 14 17:51:46 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 17:51:46 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 17:51:46 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 17:51:46 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 17:51:46 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 17:51:46 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 17:51:46 user devstack@n-api.service[61934]: X-Project-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:51:46 user devstack@n-api.service[61934]: X-Project-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:51:46 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 17:51:46 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 17:51:46 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/47e868622506423e80b158e7bf60c561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:51:46 user devstack@n-api.service[61934]: X-Tenant: tempest-TestVolumeBootPattern-725648218 Apr 14 17:51:46 user devstack@n-api.service[61934]: X-Tenant-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:51:46 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:51:46 user devstack@n-api.service[61934]: X-User: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:51:46 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 17:51:46 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 17:51:46 user devstack@n-api.service[61934]: X-User-Id: f86537c1b58843d399db6cec00012c50 Apr 14 17:51:46 user devstack@n-api.service[61934]: X-User-Name: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:51:46 user devstack@n-api.service[61934]: method: > Apr 14 17:51:46 user devstack@n-api.service[61934]: exception: Instance 413746e7-f044-4604-9ed8-be8af08de775 could not be found. Apr 14 17:51:46 user devstack@n-api.service[61934]: action_args: {'id': '413746e7-f044-4604-9ed8-be8af08de775'} Apr 14 17:51:46 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 413746e7-f044-4604-9ed8-be8af08de775 could not be found. Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 413746e7-f044-4604-9ed8-be8af08de775 could not be found. Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 413746e7-f044-4604-9ed8-be8af08de775 could not be found. Apr 14 17:51:46 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-932abd6e-f725-46be-abad-4ed7df104e8a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Returning 404 to user: Instance 413746e7-f044-4604-9ed8-be8af08de775 could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:51:46 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-932abd6e-f725-46be-abad-4ed7df104e8a tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775" status: 404 len: 111 microversion: 2.1 time: 0.037093 Apr 14 17:51:46 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 373/1120] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:51:46 2023] GET /compute/v2.1/servers/413746e7-f044-4604-9ed8-be8af08de775 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-5c6a8416-42e7-437e-badb-8bdb238c7f50 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-5c6a8416-42e7-437e-badb-8bdb238c7f50 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5c6a8416-42e7-437e-badb-8bdb238c7f50 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5c6a8416-42e7-437e-badb-8bdb238c7f50 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5c6a8416-42e7-437e-badb-8bdb238c7f50 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5c6a8416-42e7-437e-badb-8bdb238c7f50 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5c6a8416-42e7-437e-badb-8bdb238c7f50 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-5c6a8416-42e7-437e-badb-8bdb238c7f50 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:51:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-5c6a8416-42e7-437e-badb-8bdb238c7f50 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HTTP exception thrown: Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed could not be found. Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-5c6a8416-42e7-437e-badb-8bdb238c7f50 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Request method failure captured: Apr 14 17:51:46 user devstack@n-api.service[61933]: request: DELETE /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed HTTP/1.1 Apr 14 17:51:46 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:51:46 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:51:46 user devstack@n-api.service[61933]: Connection: close Apr 14 17:51:46 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:51:46 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:51:46 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:51:46 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:51:46 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOZCsNb-viKhmBQ0HTiDifBqh5pX9pTC7XXLbMHQf-psdXdwKMA4ha5ApiLG_rkKgNSVLjM5Js1w69j2ZXhPiTzXOXnuQKiD7xw7W1JnnTHt4G55p3wmQ_mkyhqbIrEl5ejyE-ni76X7010TLMaLpG_vmjlgnfxdI3G4x1tRXanWnagA Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Project-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Project-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/47e868622506423e80b158e7bf60c561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Tenant: tempest-TestVolumeBootPattern-725648218 Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Tenant-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:51:46 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:51:46 user devstack@n-api.service[61933]: X-User: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:51:46 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:51:46 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:51:46 user devstack@n-api.service[61933]: X-User-Id: f86537c1b58843d399db6cec00012c50 Apr 14 17:51:46 user devstack@n-api.service[61933]: X-User-Name: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:51:46 user devstack@n-api.service[61933]: method: > Apr 14 17:51:46 user devstack@n-api.service[61933]: exception: Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed could not be found. Apr 14 17:51:46 user devstack@n-api.service[61933]: action_args: {'id': 'bcaa9cda-dd0b-4fa2-9820-8941995f22ed'} Apr 14 17:51:46 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed could not be found. Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed could not be found. Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed could not be found. Apr 14 17:51:46 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-5c6a8416-42e7-437e-badb-8bdb238c7f50 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Returning 404 to user: Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:51:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-5c6a8416-42e7-437e-badb-8bdb238c7f50 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed" status: 404 len: 111 microversion: 2.1 time: 0.027622 Apr 14 17:51:46 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 372/1121] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:51:46 2023] DELETE /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a0604b76-79bf-486d-9299-68ef753b9902 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-a0604b76-79bf-486d-9299-68ef753b9902 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: bcaa9cda-dd0b-4fa2-9820-8941995f22ed] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a0604b76-79bf-486d-9299-68ef753b9902 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a0604b76-79bf-486d-9299-68ef753b9902 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a0604b76-79bf-486d-9299-68ef753b9902 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a0604b76-79bf-486d-9299-68ef753b9902 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a0604b76-79bf-486d-9299-68ef753b9902 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-a0604b76-79bf-486d-9299-68ef753b9902 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:51:46 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-a0604b76-79bf-486d-9299-68ef753b9902 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HTTP exception thrown: Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed could not be found. Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a0604b76-79bf-486d-9299-68ef753b9902 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Request method failure captured: Apr 14 17:51:46 user devstack@n-api.service[61935]: request: GET /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed HTTP/1.1 Apr 14 17:51:46 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:51:46 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:51:46 user devstack@n-api.service[61935]: Connection: close Apr 14 17:51:46 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:51:46 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:51:46 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:51:46 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:51:46 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOZCsNb-viKhmBQ0HTiDifBqh5pX9pTC7XXLbMHQf-psdXdwKMA4ha5ApiLG_rkKgNSVLjM5Js1w69j2ZXhPiTzXOXnuQKiD7xw7W1JnnTHt4G55p3wmQ_mkyhqbIrEl5ejyE-ni76X7010TLMaLpG_vmjlgnfxdI3G4x1tRXanWnagA Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Project-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Project-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/47e868622506423e80b158e7bf60c561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Tenant: tempest-TestVolumeBootPattern-725648218 Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Tenant-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:51:46 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:51:46 user devstack@n-api.service[61935]: X-User: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:51:46 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:51:46 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:51:46 user devstack@n-api.service[61935]: X-User-Id: f86537c1b58843d399db6cec00012c50 Apr 14 17:51:46 user devstack@n-api.service[61935]: X-User-Name: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:51:46 user devstack@n-api.service[61935]: method: > Apr 14 17:51:46 user devstack@n-api.service[61935]: exception: Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed could not be found. Apr 14 17:51:46 user devstack@n-api.service[61935]: action_args: {'id': 'bcaa9cda-dd0b-4fa2-9820-8941995f22ed'} Apr 14 17:51:46 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed could not be found. Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed could not be found. Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed could not be found. Apr 14 17:51:46 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:51:46 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-a0604b76-79bf-486d-9299-68ef753b9902 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Returning 404 to user: Instance bcaa9cda-dd0b-4fa2-9820-8941995f22ed could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:51:46 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-a0604b76-79bf-486d-9299-68ef753b9902 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed" status: 404 len: 111 microversion: 2.1 time: 0.030074 Apr 14 17:51:46 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 377/1122] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:51:46 2023] GET /compute/v2.1/servers/bcaa9cda-dd0b-4fa2-9820-8941995f22ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:51:46 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-13d5b71a-8dbc-4df3-a37a-a171043f4bd5 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Action: 'create', calling method: .version_select at 0x7fe19d1349d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1742880846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJoLHfaGoCKdd1X3AdcUdq6ctXBZV5eiAserhOEWPZWuk5iz5rhDqcv2QQXYGnnR9RtYOV7xlIelMh5HyDqSvpKlyAPpG7oYscfsMegF4fleI++KyRJHXqpIn1XvnXJrg=="}} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:51:46 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-13d5b71a-8dbc-4df3-a37a-a171043f4bd5 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting quotas for project 47e868622506423e80b158e7bf60c561. Resources: {'key_pairs'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:51:46 user devstack@n-api.service[61934]: DEBUG nova.quota [None req-13d5b71a-8dbc-4df3-a37a-a171043f4bd5 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting quotas for user f86537c1b58843d399db6cec00012c50 and project 47e868622506423e80b158e7bf60c561. Resources: {'key_pairs'} {{(pid=61934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:51:46 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-13d5b71a-8dbc-4df3-a37a-a171043f4bd5 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.053285 Apr 14 17:51:46 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 374/1123] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 17:51:46 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:51:51 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2000935952", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1742880846", "security_groups": [{"name": "tempest-secgroup-smoke-751702685"}], "block_device_mapping_v2": [{"uuid": "6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf"}]}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:51:52 user devstack@n-api.service[61933]: DEBUG nova.network.neutron [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] validate_networks() for [('e0a9bb9b-0523-41d9-a8ea-0c8772015edf', None, None, None, None, None)] {{(pid=61933) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:51:52 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:51:52 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:51:52 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:51:52 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:51:52 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:51:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:51:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:51:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:51:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:51:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:51:52 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:51:52 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting quotas for project 47e868622506423e80b158e7bf60c561. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:51:52 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting quotas for user f86537c1b58843d399db6cec00012c50 and project 47e868622506423e80b158e7bf60c561. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:51:52 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Going to run 1 instances... {{(pid=61933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:51:52 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6',volume_size=None,volume_type=None)] {{(pid=61933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:51:52 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-463ea539-ee73-43b1-bd26-d42597369112 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.827783 Apr 14 17:51:52 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 373/1124] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:51:51 2023] POST /compute/v2.1/servers => generated 403 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:51:52 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-c8f7a398-1728-4175-a97c-c516c950b178 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:51:52 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-c8f7a398-1728-4175-a97c-c516c950b178 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:51:52 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-c8f7a398-1728-4175-a97c-c516c950b178 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:51:52 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-c8f7a398-1728-4175-a97c-c516c950b178 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d" status: 200 len: 1090 microversion: 2.1 time: 0.071368 Apr 14 17:51:52 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 378/1125] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:51:52 2023] GET /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d => generated 1090 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:51:55 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-f111d855-d114-442d-b3b3-732771aa82c2 req-8aeba5d8-d8f3-4ae3-be13-ec8935854990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb7c2884-b149-448d-b00e-35962ae3386d", "tag": "719203df-3d6c-4ded-8913-07b73fd3c374"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:51:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-f111d855-d114-442d-b3b3-732771aa82c2 req-8aeba5d8-d8f3-4ae3-be13-ec8935854990 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:51:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-f111d855-d114-442d-b3b3-732771aa82c2 req-8aeba5d8-d8f3-4ae3-be13-ec8935854990 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:51:55 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-f111d855-d114-442d-b3b3-732771aa82c2 req-8aeba5d8-d8f3-4ae3-be13-ec8935854990 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:51:55 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-f111d855-d114-442d-b3b3-732771aa82c2 req-8aeba5d8-d8f3-4ae3-be13-ec8935854990 service nova] Creating event network-changed:719203df-3d6c-4ded-8913-07b73fd3c374 for instance eb7c2884-b149-448d-b00e-35962ae3386d on user Apr 14 17:51:55 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-f111d855-d114-442d-b3b3-732771aa82c2 req-8aeba5d8-d8f3-4ae3-be13-ec8935854990 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033439 Apr 14 17:51:55 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 375/1126] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:51:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:52:03 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:52:03 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:52:03 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:52:03 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:52:04 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-fda0a32d-af60-4ca9-aefd-11140a75c03d req-f577d946-5b60-454f-889d-6438cace8166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb7c2884-b149-448d-b00e-35962ae3386d", "name": "network-vif-plugged", "status": "completed", "tag": "719203df-3d6c-4ded-8913-07b73fd3c374"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:52:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-fda0a32d-af60-4ca9-aefd-11140a75c03d req-f577d946-5b60-454f-889d-6438cace8166 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:52:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-fda0a32d-af60-4ca9-aefd-11140a75c03d req-f577d946-5b60-454f-889d-6438cace8166 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:52:04 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-fda0a32d-af60-4ca9-aefd-11140a75c03d req-f577d946-5b60-454f-889d-6438cace8166 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:52:04 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-fda0a32d-af60-4ca9-aefd-11140a75c03d req-f577d946-5b60-454f-889d-6438cace8166 service nova] Creating event network-vif-plugged:719203df-3d6c-4ded-8913-07b73fd3c374 for instance eb7c2884-b149-448d-b00e-35962ae3386d on user Apr 14 17:52:04 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-fda0a32d-af60-4ca9-aefd-11140a75c03d req-f577d946-5b60-454f-889d-6438cace8166 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128744 Apr 14 17:52:04 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 374/1127] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:52:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:52:06 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-4e10c372-e079-44f3-a6d4-6a9e6cd780af req-c0a3b8bb-1e9b-4f00-9023-155f058f1d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb7c2884-b149-448d-b00e-35962ae3386d", "name": "network-vif-plugged", "status": "completed", "tag": "719203df-3d6c-4ded-8913-07b73fd3c374"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:52:06 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:52:06 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=8 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:52:06 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:52:06 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-4e10c372-e079-44f3-a6d4-6a9e6cd780af req-c0a3b8bb-1e9b-4f00-9023-155f058f1d7b service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:52:06 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-4e10c372-e079-44f3-a6d4-6a9e6cd780af req-c0a3b8bb-1e9b-4f00-9023-155f058f1d7b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:52:06 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-4e10c372-e079-44f3-a6d4-6a9e6cd780af req-c0a3b8bb-1e9b-4f00-9023-155f058f1d7b service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:52:06 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-4e10c372-e079-44f3-a6d4-6a9e6cd780af req-c0a3b8bb-1e9b-4f00-9023-155f058f1d7b service nova] Creating event network-vif-plugged:719203df-3d6c-4ded-8913-07b73fd3c374 for instance eb7c2884-b149-448d-b00e-35962ae3386d on user Apr 14 17:52:06 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-4e10c372-e079-44f3-a6d4-6a9e6cd780af req-c0a3b8bb-1e9b-4f00-9023-155f058f1d7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035823 Apr 14 17:52:06 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 379/1128] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:52:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:52:42 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:52:42 user devstack@n-api.service[61934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:52:42 user devstack@n-api.service[61934]: Fri Apr 14 17:52:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d (ip 10.0.0.210) !!! Apr 14 17:52:42 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:52:42 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:52:42 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-24589a4a-de52-4f0d-bcb8-77ed39d85f52 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:52:42 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-24589a4a-de52-4f0d-bcb8-77ed39d85f52 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:52:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-24589a4a-de52-4f0d-bcb8-77ed39d85f52 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:52:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-24589a4a-de52-4f0d-bcb8-77ed39d85f52 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:52:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-24589a4a-de52-4f0d-bcb8-77ed39d85f52 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:52:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-24589a4a-de52-4f0d-bcb8-77ed39d85f52 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:52:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-24589a4a-de52-4f0d-bcb8-77ed39d85f52 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:52:42 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-24589a4a-de52-4f0d-bcb8-77ed39d85f52 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:52:43 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-24589a4a-de52-4f0d-bcb8-77ed39d85f52 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:52:43 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-24589a4a-de52-4f0d-bcb8-77ed39d85f52 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d" status: 200 len: 1441 microversion: 2.1 time: 0.231222 Apr 14 17:52:43 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 376/1129] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:52:42 2023] GET /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d => generated 1441 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:53:43 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:53:43 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:53:43 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-9136a795-830a-4f7b-b1c7-95b4616e57ec tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:53:43 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-9136a795-830a-4f7b-b1c7-95b4616e57ec tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:53:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9136a795-830a-4f7b-b1c7-95b4616e57ec tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:53:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9136a795-830a-4f7b-b1c7-95b4616e57ec tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:53:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9136a795-830a-4f7b-b1c7-95b4616e57ec tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:53:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9136a795-830a-4f7b-b1c7-95b4616e57ec tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:53:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9136a795-830a-4f7b-b1c7-95b4616e57ec tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:53:43 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-9136a795-830a-4f7b-b1c7-95b4616e57ec tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:53:43 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-9136a795-830a-4f7b-b1c7-95b4616e57ec tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:53:43 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-9136a795-830a-4f7b-b1c7-95b4616e57ec tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d" status: 200 len: 1441 microversion: 2.1 time: 0.592486 Apr 14 17:53:43 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 375/1130] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:53:43 2023] GET /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d => generated 1441 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:53:45 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:53:45 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:53:45 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-611b3c7d-c0f5-43a9-bf57-3c5e844a59b9 req-08519a99-8aa9-4aea-b9a1-2ef81054270c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb7c2884-b149-448d-b00e-35962ae3386d", "tag": "719203df-3d6c-4ded-8913-07b73fd3c374"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:53:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-611b3c7d-c0f5-43a9-bf57-3c5e844a59b9 req-08519a99-8aa9-4aea-b9a1-2ef81054270c service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:53:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-611b3c7d-c0f5-43a9-bf57-3c5e844a59b9 req-08519a99-8aa9-4aea-b9a1-2ef81054270c service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:53:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-611b3c7d-c0f5-43a9-bf57-3c5e844a59b9 req-08519a99-8aa9-4aea-b9a1-2ef81054270c service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:53:45 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-611b3c7d-c0f5-43a9-bf57-3c5e844a59b9 req-08519a99-8aa9-4aea-b9a1-2ef81054270c service nova] Creating event network-changed:719203df-3d6c-4ded-8913-07b73fd3c374 for instance eb7c2884-b149-448d-b00e-35962ae3386d on user Apr 14 17:53:45 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-611b3c7d-c0f5-43a9-bf57-3c5e844a59b9 req-08519a99-8aa9-4aea-b9a1-2ef81054270c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038386 Apr 14 17:53:45 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 380/1131] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:53:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:53:45 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:53:45 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:53:45 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:53:45 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:53:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:53:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:53:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:53:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:53:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:53:45 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:53:45 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Going to try to terminate instance {{(pid=61934) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:53:45 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-3f23afae-e856-44b0-80e7-e3f18cee81ac tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d" status: 204 len: 0 microversion: 2.1 time: 0.125327 Apr 14 17:53:45 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 377/1132] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:53:45 2023] DELETE /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:53:45 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-f7b7b01d-4668-426b-88b8-e12113853ca1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:53:45 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-f7b7b01d-4668-426b-88b8-e12113853ca1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:53:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f7b7b01d-4668-426b-88b8-e12113853ca1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:53:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f7b7b01d-4668-426b-88b8-e12113853ca1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:53:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f7b7b01d-4668-426b-88b8-e12113853ca1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:53:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f7b7b01d-4668-426b-88b8-e12113853ca1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:53:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f7b7b01d-4668-426b-88b8-e12113853ca1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:53:45 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-f7b7b01d-4668-426b-88b8-e12113853ca1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:53:45 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-f7b7b01d-4668-426b-88b8-e12113853ca1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:53:45 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-f7b7b01d-4668-426b-88b8-e12113853ca1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d" status: 200 len: 1447 microversion: 2.1 time: 0.198818 Apr 14 17:53:45 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 376/1133] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:53:45 2023] GET /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d => generated 1447 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:53:47 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb7c2884-b149-448d-b00e-35962ae3386d", "name": "network-vif-unplugged", "status": "completed", "tag": "719203df-3d6c-4ded-8913-07b73fd3c374"}, {"server_uuid": "eb7c2884-b149-448d-b00e-35962ae3386d", "name": "network-vif-plugged", "status": "completed", "tag": "719203df-3d6c-4ded-8913-07b73fd3c374"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:53:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:53:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:53:47 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:53:47 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] Creating event network-vif-unplugged:719203df-3d6c-4ded-8913-07b73fd3c374 for instance eb7c2884-b149-448d-b00e-35962ae3386d on user Apr 14 17:53:47 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] Creating event network-vif-plugged:719203df-3d6c-4ded-8913-07b73fd3c374 for instance eb7c2884-b149-448d-b00e-35962ae3386d on user Apr 14 17:53:47 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-d1215ad9-9373-4ed5-9a75-b1e5e4852cd4 req-ef8e26f1-d166-4724-945b-0c2061e5331e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031434 Apr 14 17:53:47 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 381/1134] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:53:47 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:53:47 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-5f72e04c-edca-4e42-a1c7-d03e36ad0c49 req-ad31458e-ce21-420a-9005-038e246208af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb7c2884-b149-448d-b00e-35962ae3386d", "name": "network-vif-deleted", "tag": "719203df-3d6c-4ded-8913-07b73fd3c374"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:53:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5f72e04c-edca-4e42-a1c7-d03e36ad0c49 req-ad31458e-ce21-420a-9005-038e246208af service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:53:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5f72e04c-edca-4e42-a1c7-d03e36ad0c49 req-ad31458e-ce21-420a-9005-038e246208af service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:53:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5f72e04c-edca-4e42-a1c7-d03e36ad0c49 req-ad31458e-ce21-420a-9005-038e246208af service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:53:47 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-5f72e04c-edca-4e42-a1c7-d03e36ad0c49 req-ad31458e-ce21-420a-9005-038e246208af service nova] Creating event network-vif-deleted:719203df-3d6c-4ded-8913-07b73fd3c374 for instance eb7c2884-b149-448d-b00e-35962ae3386d on user Apr 14 17:53:47 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-5f72e04c-edca-4e42-a1c7-d03e36ad0c49 req-ad31458e-ce21-420a-9005-038e246208af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097883 Apr 14 17:53:47 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 378/1135] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:53:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:54:35 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b22d06c9-e33b-44b5-9c37-415934ae551c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:54:35 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-b22d06c9-e33b-44b5-9c37-415934ae551c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:54:35 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:54:35 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=12 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:54:35 user devstack@n-api.service[61933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 17:54:35 user devstack@n-api.service[61933]: Fri Apr 14 17:54:35 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d (ip 10.0.0.210) !!! Apr 14 17:54:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b22d06c9-e33b-44b5-9c37-415934ae551c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:54:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b22d06c9-e33b-44b5-9c37-415934ae551c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:54:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b22d06c9-e33b-44b5-9c37-415934ae551c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:54:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b22d06c9-e33b-44b5-9c37-415934ae551c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:54:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b22d06c9-e33b-44b5-9c37-415934ae551c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:54:35 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-b22d06c9-e33b-44b5-9c37-415934ae551c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:54:35 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-b22d06c9-e33b-44b5-9c37-415934ae551c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HTTP exception thrown: Instance eb7c2884-b149-448d-b00e-35962ae3386d could not be found. Apr 14 17:54:35 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b22d06c9-e33b-44b5-9c37-415934ae551c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Request method failure captured: Apr 14 17:54:35 user devstack@n-api.service[61933]: request: GET /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d HTTP/1.1 Apr 14 17:54:35 user devstack@n-api.service[61933]: Accept: application/json Apr 14 17:54:35 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 17:54:35 user devstack@n-api.service[61933]: Connection: close Apr 14 17:54:35 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 17:54:35 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 17:54:35 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 17:54:35 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 17:54:35 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 17:54:35 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOZCsNb-viKhmBQ0HTiDifBqh5pX9pTC7XXLbMHQf-psdXdwKMA4ha5ApiLG_rkKgNSVLjM5Js1w69j2ZXhPiTzXOXnuQKiD7xw7W1JnnTHt4G55p3wmQ_mkyhqbIrEl5ejyE-ni76X7010TLMaLpG_vmjlgnfxdI3G4x1tRXanWnagA Apr 14 17:54:35 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 17:54:35 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 17:54:35 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 17:54:35 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 17:54:35 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 17:54:35 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 17:54:35 user devstack@n-api.service[61933]: X-Project-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:54:35 user devstack@n-api.service[61933]: X-Project-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:54:35 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 17:54:35 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 17:54:35 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/47e868622506423e80b158e7bf60c561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:54:35 user devstack@n-api.service[61933]: X-Tenant: tempest-TestVolumeBootPattern-725648218 Apr 14 17:54:35 user devstack@n-api.service[61933]: X-Tenant-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:54:35 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:54:35 user devstack@n-api.service[61933]: X-User: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:54:35 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 17:54:35 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 17:54:35 user devstack@n-api.service[61933]: X-User-Id: f86537c1b58843d399db6cec00012c50 Apr 14 17:54:35 user devstack@n-api.service[61933]: X-User-Name: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:54:35 user devstack@n-api.service[61933]: method: > Apr 14 17:54:35 user devstack@n-api.service[61933]: exception: Instance eb7c2884-b149-448d-b00e-35962ae3386d could not be found. Apr 14 17:54:35 user devstack@n-api.service[61933]: action_args: {'id': 'eb7c2884-b149-448d-b00e-35962ae3386d'} Apr 14 17:54:35 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb7c2884-b149-448d-b00e-35962ae3386d could not be found. Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb7c2884-b149-448d-b00e-35962ae3386d could not be found. Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb7c2884-b149-448d-b00e-35962ae3386d could not be found. Apr 14 17:54:35 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 17:54:35 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-b22d06c9-e33b-44b5-9c37-415934ae551c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Returning 404 to user: Instance eb7c2884-b149-448d-b00e-35962ae3386d could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:54:35 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-b22d06c9-e33b-44b5-9c37-415934ae551c tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d" status: 404 len: 111 microversion: 2.1 time: 0.055444 Apr 14 17:54:35 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 377/1136] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:54:35 2023] GET /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:54:36 user devstack@n-api.service[61935]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 17:54:36 user devstack@n-api.service[61935]: Fri Apr 14 17:54:36 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1556605766", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1742880846", "security_groups": [{"name": "tempest-secgroup-smoke-751702685"}], "block_device_mapping_v2": [{"uuid": "6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf"}]}} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG nova.network.neutron [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] validate_networks() for [('e0a9bb9b-0523-41d9-a8ea-0c8772015edf', None, None, None, None, None)] {{(pid=61935) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image limits 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image pref 0:0:0 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG nova.virt.hardware [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting quotas for project 47e868622506423e80b158e7bf60c561. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG nova.quota [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting quotas for user f86537c1b58843d399db6cec00012c50 and project 47e868622506423e80b158e7bf60c561. Resources: {'cores', 'ram', 'instances'} {{(pid=61935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Going to run 1 instances... {{(pid=61935) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:54:36 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6ff77ff6-bdda-4ab8-9768-0e72ef14ceb6',volume_size=None,volume_type=None)] {{(pid=61935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:54:37 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-ea60b6ff-f9d2-4956-84d8-c90731ae031f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.121543 Apr 14 17:54:37 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 382/1137] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:54:36 2023] POST /compute/v2.1/servers => generated 403 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:54:37 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:54:37 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:54:37 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-966a8e1f-4817-49c2-a95b-14ebb77913af tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:54:37 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-966a8e1f-4817-49c2-a95b-14ebb77913af tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:54:37 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-966a8e1f-4817-49c2-a95b-14ebb77913af tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:54:37 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-966a8e1f-4817-49c2-a95b-14ebb77913af tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a094ec7-baee-4f61-99e1-33e1e45e6fda" status: 200 len: 1090 microversion: 2.1 time: 0.100838 Apr 14 17:54:37 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 379/1138] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:54:37 2023] GET /compute/v2.1/servers/7a094ec7-baee-4f61-99e1-33e1e45e6fda => generated 1090 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:54:39 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-0aef852e-ebaa-4a2b-8858-da44ffb933d2 req-befcb2b3-be03-4feb-be83-fd07760cf419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a094ec7-baee-4f61-99e1-33e1e45e6fda", "tag": "b4433608-caeb-4871-adcd-2dd00c74035f"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:54:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-0aef852e-ebaa-4a2b-8858-da44ffb933d2 req-befcb2b3-be03-4feb-be83-fd07760cf419 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:54:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-0aef852e-ebaa-4a2b-8858-da44ffb933d2 req-befcb2b3-be03-4feb-be83-fd07760cf419 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:54:39 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-0aef852e-ebaa-4a2b-8858-da44ffb933d2 req-befcb2b3-be03-4feb-be83-fd07760cf419 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:54:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-0aef852e-ebaa-4a2b-8858-da44ffb933d2 req-befcb2b3-be03-4feb-be83-fd07760cf419 service nova] Creating event network-changed:b4433608-caeb-4871-adcd-2dd00c74035f for instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda on user Apr 14 17:54:39 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-0aef852e-ebaa-4a2b-8858-da44ffb933d2 req-befcb2b3-be03-4feb-be83-fd07760cf419 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030437 Apr 14 17:54:39 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 378/1139] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:54:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:54:45 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-32634538-82de-42cc-ac54-4ebde7749901 req-6c30e599-c045-4469-9f72-fcba41461653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a094ec7-baee-4f61-99e1-33e1e45e6fda", "name": "network-vif-plugged", "status": "completed", "tag": "b4433608-caeb-4871-adcd-2dd00c74035f"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:54:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-32634538-82de-42cc-ac54-4ebde7749901 req-6c30e599-c045-4469-9f72-fcba41461653 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:54:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-32634538-82de-42cc-ac54-4ebde7749901 req-6c30e599-c045-4469-9f72-fcba41461653 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:54:45 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-32634538-82de-42cc-ac54-4ebde7749901 req-6c30e599-c045-4469-9f72-fcba41461653 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:54:45 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-32634538-82de-42cc-ac54-4ebde7749901 req-6c30e599-c045-4469-9f72-fcba41461653 service nova] Creating event network-vif-plugged:b4433608-caeb-4871-adcd-2dd00c74035f for instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda on user Apr 14 17:54:45 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-32634538-82de-42cc-ac54-4ebde7749901 req-6c30e599-c045-4469-9f72-fcba41461653 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053402 Apr 14 17:54:45 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 383/1140] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:54:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:54:47 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-bd8c1697-476f-4e0d-83ff-4fd2f9b8ec7b req-426cb913-0fcc-49f4-ad23-74c9d91fd2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a094ec7-baee-4f61-99e1-33e1e45e6fda", "name": "network-vif-plugged", "status": "completed", "tag": "b4433608-caeb-4871-adcd-2dd00c74035f"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:54:47 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=4 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:54:47 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell0:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:54:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-bd8c1697-476f-4e0d-83ff-4fd2f9b8ec7b req-426cb913-0fcc-49f4-ad23-74c9d91fd2b6 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:54:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-bd8c1697-476f-4e0d-83ff-4fd2f9b8ec7b req-426cb913-0fcc-49f4-ad23-74c9d91fd2b6 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:54:47 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-bd8c1697-476f-4e0d-83ff-4fd2f9b8ec7b req-426cb913-0fcc-49f4-ad23-74c9d91fd2b6 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:54:47 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-bd8c1697-476f-4e0d-83ff-4fd2f9b8ec7b req-426cb913-0fcc-49f4-ad23-74c9d91fd2b6 service nova] Creating event network-vif-plugged:b4433608-caeb-4871-adcd-2dd00c74035f for instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda on user Apr 14 17:54:47 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-bd8c1697-476f-4e0d-83ff-4fd2f9b8ec7b req-426cb913-0fcc-49f4-ad23-74c9d91fd2b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036712 Apr 14 17:54:47 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 380/1141] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:54:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:55:27 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:55:27 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:55:27 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-6828f50e-6edd-42b0-a803-05ff054548da tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:55:27 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-6828f50e-6edd-42b0-a803-05ff054548da tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:55:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6828f50e-6edd-42b0-a803-05ff054548da tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:55:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6828f50e-6edd-42b0-a803-05ff054548da tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:55:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6828f50e-6edd-42b0-a803-05ff054548da tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:55:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6828f50e-6edd-42b0-a803-05ff054548da tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:55:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6828f50e-6edd-42b0-a803-05ff054548da tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:55:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-6828f50e-6edd-42b0-a803-05ff054548da tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:55:27 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-6828f50e-6edd-42b0-a803-05ff054548da tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:55:27 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-6828f50e-6edd-42b0-a803-05ff054548da tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a094ec7-baee-4f61-99e1-33e1e45e6fda" status: 200 len: 1442 microversion: 2.1 time: 0.232916 Apr 14 17:55:27 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 379/1142] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:55:27 2023] GET /compute/v2.1/servers/7a094ec7-baee-4f61-99e1-33e1e45e6fda => generated 1442 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:56:27 user devstack@n-api.service[61935]: ERROR oslo.messaging._drivers.impl_rabbit [-] [08b4fb43-252f-49c7-a4f2-e609853ccb81] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 17:56:27 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:56:27 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:56:27 user devstack@n-api.service[61935]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:56:27 user devstack@n-api.service[61935]: Fri Apr 14 17:56:27 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a094ec7-baee-4f61-99e1-33e1e45e6fda (ip 10.0.0.210) !!! Apr 14 17:56:27 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:56:27 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:56:27 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-8b8d578f-c14a-4c04-972e-57088ed899e8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:56:27 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-8b8d578f-c14a-4c04-972e-57088ed899e8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:56:27 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8b8d578f-c14a-4c04-972e-57088ed899e8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:56:27 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8b8d578f-c14a-4c04-972e-57088ed899e8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:56:27 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8b8d578f-c14a-4c04-972e-57088ed899e8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:56:27 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8b8d578f-c14a-4c04-972e-57088ed899e8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:56:27 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8b8d578f-c14a-4c04-972e-57088ed899e8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:56:27 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-8b8d578f-c14a-4c04-972e-57088ed899e8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:56:28 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-8b8d578f-c14a-4c04-972e-57088ed899e8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:56:28 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-8b8d578f-c14a-4c04-972e-57088ed899e8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a094ec7-baee-4f61-99e1-33e1e45e6fda" status: 200 len: 1442 microversion: 2.1 time: 0.384681 Apr 14 17:56:28 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 384/1143] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:56:27 2023] GET /compute/v2.1/servers/7a094ec7-baee-4f61-99e1-33e1e45e6fda => generated 1442 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:56:29 user devstack@n-api.service[61934]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f9c1eadf-1445-413a-a06d-1e6fd2e4b8ab] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 17:56:29 user devstack@n-api.service[61934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:56:29 user devstack@n-api.service[61934]: Fri Apr 14 17:56:29 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 17:56:29 user devstack@n-api.service[61934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:56:29 user devstack@n-api.service[61934]: Fri Apr 14 17:56:29 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 17:56:29 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:56:29 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:56:29 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-ca6a0bae-87a0-4efe-8e7d-b8f5b82728c2 req-5299ed1c-cc11-46c0-8848-02f4286ed9bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a094ec7-baee-4f61-99e1-33e1e45e6fda", "tag": "b4433608-caeb-4871-adcd-2dd00c74035f"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:56:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ca6a0bae-87a0-4efe-8e7d-b8f5b82728c2 req-5299ed1c-cc11-46c0-8848-02f4286ed9bc service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:56:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ca6a0bae-87a0-4efe-8e7d-b8f5b82728c2 req-5299ed1c-cc11-46c0-8848-02f4286ed9bc service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:56:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ca6a0bae-87a0-4efe-8e7d-b8f5b82728c2 req-5299ed1c-cc11-46c0-8848-02f4286ed9bc service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:56:29 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-ca6a0bae-87a0-4efe-8e7d-b8f5b82728c2 req-5299ed1c-cc11-46c0-8848-02f4286ed9bc service nova] Creating event network-changed:b4433608-caeb-4871-adcd-2dd00c74035f for instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda on user Apr 14 17:56:29 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-ca6a0bae-87a0-4efe-8e7d-b8f5b82728c2 req-5299ed1c-cc11-46c0-8848-02f4286ed9bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097272 Apr 14 17:56:29 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 381/1144] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:56:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:56:36 user devstack@n-api.service[61933]: ERROR oslo.messaging._drivers.impl_rabbit [-] [afd27a4e-5552-43ff-898c-c1fed5e8c593] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 17:56:36 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:56:36 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:56:36 user devstack@n-api.service[61933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:56:36 user devstack@n-api.service[61933]: Fri Apr 14 17:56:36 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 14 17:56:36 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-583350731", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1742880846", "security_groups": [{"name": "tempest-secgroup-smoke-751702685"}], "block_device_mapping_v2": [{"uuid": "56dd664d-d444-40c1-8b62-667369a174b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e0a9bb9b-0523-41d9-a8ea-0c8772015edf"}]}} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:56:36 user devstack@n-api.service[61933]: DEBUG nova.network.neutron [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] validate_networks() for [('e0a9bb9b-0523-41d9-a8ea-0c8772015edf', None, None, None, None, None)] {{(pid=61933) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 17:56:37 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 17:56:37 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image limits 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 17:56:37 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Flavor pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 17:56:37 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Image pref 0:0:0 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 17:56:37 user devstack@n-api.service[61933]: DEBUG nova.virt.hardware [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 17:56:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:56:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:56:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:56:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:56:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:56:37 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:56:37 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting quotas for project 47e868622506423e80b158e7bf60c561. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 17:56:37 user devstack@n-api.service[61933]: DEBUG nova.quota [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Getting quotas for user f86537c1b58843d399db6cec00012c50 and project 47e868622506423e80b158e7bf60c561. Resources: {'cores', 'ram', 'instances'} {{(pid=61933) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 17:56:37 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Going to run 1 instances... {{(pid=61933) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 17:56:37 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='56dd664d-d444-40c1-8b62-667369a174b3',volume_size=None,volume_type=None)] {{(pid=61933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 17:56:37 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-7427b646-33ed-4061-8bc2-b86df7bc977f tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.872184 Apr 14 17:56:37 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 380/1145] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 17:56:36 2023] POST /compute/v2.1/servers => generated 403 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 17:56:37 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-010b334c-ec42-4090-9397-46dc029bd567 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:56:37 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-010b334c-ec42-4090-9397-46dc029bd567 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:56:37 user devstack@n-api.service[61935]: INFO oslo.messaging._drivers.impl_rabbit [-] [08b4fb43-252f-49c7-a4f2-e609853ccb81] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 43590. Apr 14 17:56:37 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-010b334c-ec42-4090-9397-46dc029bd567 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:56:37 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-010b334c-ec42-4090-9397-46dc029bd567 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ee241cb-0eeb-4aa3-ab54-89427b437a3a" status: 200 len: 1089 microversion: 2.1 time: 0.085835 Apr 14 17:56:37 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 385/1146] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:56:37 2023] GET /compute/v2.1/servers/7ee241cb-0eeb-4aa3-ab54-89427b437a3a => generated 1089 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:56:40 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:56:40 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:56:40 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-7a9bcdb4-c146-476b-bf54-f57121f6ff19 req-7d2ce662-304e-4d1f-b82d-0c51f727a551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee241cb-0eeb-4aa3-ab54-89427b437a3a", "tag": "90bb3866-d29e-4bcb-8927-e5536e59715e"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:56:40 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-7a9bcdb4-c146-476b-bf54-f57121f6ff19 req-7d2ce662-304e-4d1f-b82d-0c51f727a551 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:56:40 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-7a9bcdb4-c146-476b-bf54-f57121f6ff19 req-7d2ce662-304e-4d1f-b82d-0c51f727a551 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:56:40 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-7a9bcdb4-c146-476b-bf54-f57121f6ff19 req-7d2ce662-304e-4d1f-b82d-0c51f727a551 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:56:40 user devstack@n-api.service[61934]: INFO oslo.messaging._drivers.impl_rabbit [-] [f9c1eadf-1445-413a-a06d-1e6fd2e4b8ab] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 43600. Apr 14 17:56:40 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-7a9bcdb4-c146-476b-bf54-f57121f6ff19 req-7d2ce662-304e-4d1f-b82d-0c51f727a551 service nova] Creating event network-changed:90bb3866-d29e-4bcb-8927-e5536e59715e for instance 7ee241cb-0eeb-4aa3-ab54-89427b437a3a on user Apr 14 17:56:40 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-7a9bcdb4-c146-476b-bf54-f57121f6ff19 req-7d2ce662-304e-4d1f-b82d-0c51f727a551 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042184 Apr 14 17:56:40 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 382/1147] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:56:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:56:46 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-994a2a46-ed50-462d-8eee-439fa121dc25 req-8cc14d30-a054-48a3-a4ef-3afceab9de5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee241cb-0eeb-4aa3-ab54-89427b437a3a", "name": "network-vif-plugged", "status": "completed", "tag": "90bb3866-d29e-4bcb-8927-e5536e59715e"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:56:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-994a2a46-ed50-462d-8eee-439fa121dc25 req-8cc14d30-a054-48a3-a4ef-3afceab9de5e service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:56:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-994a2a46-ed50-462d-8eee-439fa121dc25 req-8cc14d30-a054-48a3-a4ef-3afceab9de5e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:56:46 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-994a2a46-ed50-462d-8eee-439fa121dc25 req-8cc14d30-a054-48a3-a4ef-3afceab9de5e service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:56:46 user devstack@n-api.service[61933]: INFO oslo.messaging._drivers.impl_rabbit [-] [afd27a4e-5552-43ff-898c-c1fed5e8c593] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 46224. Apr 14 17:56:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-994a2a46-ed50-462d-8eee-439fa121dc25 req-8cc14d30-a054-48a3-a4ef-3afceab9de5e service nova] Creating event network-vif-plugged:90bb3866-d29e-4bcb-8927-e5536e59715e for instance 7ee241cb-0eeb-4aa3-ab54-89427b437a3a on user Apr 14 17:56:46 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-994a2a46-ed50-462d-8eee-439fa121dc25 req-8cc14d30-a054-48a3-a4ef-3afceab9de5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034953 Apr 14 17:56:46 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 381/1148] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:56:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:56:48 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-87b43784-a510-4ff5-9bba-02e3bc33307e req-474c88ab-9ff8-4072-b36a-09c0a102bbde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee241cb-0eeb-4aa3-ab54-89427b437a3a", "name": "network-vif-plugged", "status": "completed", "tag": "90bb3866-d29e-4bcb-8927-e5536e59715e"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:56:48 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:56:48 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=6 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:56:48 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell0:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:56:48 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-87b43784-a510-4ff5-9bba-02e3bc33307e req-474c88ab-9ff8-4072-b36a-09c0a102bbde service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:56:48 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-87b43784-a510-4ff5-9bba-02e3bc33307e req-474c88ab-9ff8-4072-b36a-09c0a102bbde service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:56:48 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-87b43784-a510-4ff5-9bba-02e3bc33307e req-474c88ab-9ff8-4072-b36a-09c0a102bbde service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:56:48 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-87b43784-a510-4ff5-9bba-02e3bc33307e req-474c88ab-9ff8-4072-b36a-09c0a102bbde service nova] Creating event network-vif-plugged:90bb3866-d29e-4bcb-8927-e5536e59715e for instance 7ee241cb-0eeb-4aa3-ab54-89427b437a3a on user Apr 14 17:56:48 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-87b43784-a510-4ff5-9bba-02e3bc33307e req-474c88ab-9ff8-4072-b36a-09c0a102bbde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034751 Apr 14 17:56:48 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 386/1149] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:56:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:57:27 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:57:27 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:57:27 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-28094bf2-baea-4f3a-9dd9-633c72445c6e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:57:27 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-28094bf2-baea-4f3a-9dd9-633c72445c6e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:57:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-28094bf2-baea-4f3a-9dd9-633c72445c6e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:57:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-28094bf2-baea-4f3a-9dd9-633c72445c6e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:57:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-28094bf2-baea-4f3a-9dd9-633c72445c6e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:57:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-28094bf2-baea-4f3a-9dd9-633c72445c6e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:57:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-28094bf2-baea-4f3a-9dd9-633c72445c6e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:57:27 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-28094bf2-baea-4f3a-9dd9-633c72445c6e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:57:27 user devstack@n-api.service[61934]: DEBUG nova.policy [None req-28094bf2-baea-4f3a-9dd9-633c72445c6e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61934) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:57:27 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-28094bf2-baea-4f3a-9dd9-633c72445c6e tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ee241cb-0eeb-4aa3-ab54-89427b437a3a" status: 200 len: 1440 microversion: 2.1 time: 0.283472 Apr 14 17:57:27 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 383/1150] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:57:27 2023] GET /compute/v2.1/servers/7ee241cb-0eeb-4aa3-ab54-89427b437a3a => generated 1440 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:58:27 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=2 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:58:27 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell0:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:58:27 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:58:27 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:58:27 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-301c2644-9de4-47f8-8df1-1d3ff5e49ed1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:58:27 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-301c2644-9de4-47f8-8df1-1d3ff5e49ed1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:58:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-301c2644-9de4-47f8-8df1-1d3ff5e49ed1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:58:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-301c2644-9de4-47f8-8df1-1d3ff5e49ed1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:58:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-301c2644-9de4-47f8-8df1-1d3ff5e49ed1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:58:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-301c2644-9de4-47f8-8df1-1d3ff5e49ed1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:58:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-301c2644-9de4-47f8-8df1-1d3ff5e49ed1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:58:27 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-301c2644-9de4-47f8-8df1-1d3ff5e49ed1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:58:28 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-301c2644-9de4-47f8-8df1-1d3ff5e49ed1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:58:28 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-301c2644-9de4-47f8-8df1-1d3ff5e49ed1 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ee241cb-0eeb-4aa3-ab54-89427b437a3a" status: 200 len: 1440 microversion: 2.1 time: 0.314144 Apr 14 17:58:28 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 382/1151] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:58:27 2023] GET /compute/v2.1/servers/7ee241cb-0eeb-4aa3-ab54-89427b437a3a => generated 1440 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:58:29 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:58:29 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=2 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:58:29 user devstack@n-api.service[61935]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 17:58:29 user devstack@n-api.service[61935]: Fri Apr 14 17:58:29 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 17:58:29 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-76d1959e-7346-4baa-8c2f-0144e64a0479 req-c63c7ea2-e2fa-4c2b-a4a4-5cff18d9054d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee241cb-0eeb-4aa3-ab54-89427b437a3a", "tag": "90bb3866-d29e-4bcb-8927-e5536e59715e"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:58:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-76d1959e-7346-4baa-8c2f-0144e64a0479 req-c63c7ea2-e2fa-4c2b-a4a4-5cff18d9054d service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:58:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-76d1959e-7346-4baa-8c2f-0144e64a0479 req-c63c7ea2-e2fa-4c2b-a4a4-5cff18d9054d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:58:30 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-76d1959e-7346-4baa-8c2f-0144e64a0479 req-c63c7ea2-e2fa-4c2b-a4a4-5cff18d9054d service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:58:30 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-76d1959e-7346-4baa-8c2f-0144e64a0479 req-c63c7ea2-e2fa-4c2b-a4a4-5cff18d9054d service nova] Creating event network-changed:90bb3866-d29e-4bcb-8927-e5536e59715e for instance 7ee241cb-0eeb-4aa3-ab54-89427b437a3a on user Apr 14 17:58:30 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-76d1959e-7346-4baa-8c2f-0144e64a0479 req-c63c7ea2-e2fa-4c2b-a4a4-5cff18d9054d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129120 Apr 14 17:58:30 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 387/1152] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:58:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:58:31 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=2 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:58:31 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=6 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:58:31 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:58:31 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:58:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:58:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:58:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:58:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:58:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:58:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:58:31 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Going to try to terminate instance {{(pid=61934) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:58:31 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-2a814fff-731d-41b3-a4c8-a6548cc1f025 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7ee241cb-0eeb-4aa3-ab54-89427b437a3a" status: 204 len: 0 microversion: 2.1 time: 0.221713 Apr 14 17:58:31 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 384/1153] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:58:31 2023] DELETE /compute/v2.1/servers/7ee241cb-0eeb-4aa3-ab54-89427b437a3a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:58:31 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-e9405556-4468-4ce8-93be-a033dea59c89 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:58:31 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-e9405556-4468-4ce8-93be-a033dea59c89 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:58:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e9405556-4468-4ce8-93be-a033dea59c89 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:58:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e9405556-4468-4ce8-93be-a033dea59c89 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:58:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e9405556-4468-4ce8-93be-a033dea59c89 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:58:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e9405556-4468-4ce8-93be-a033dea59c89 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:58:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e9405556-4468-4ce8-93be-a033dea59c89 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:58:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-e9405556-4468-4ce8-93be-a033dea59c89 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:58:32 user devstack@n-api.service[61933]: DEBUG nova.policy [None req-e9405556-4468-4ce8-93be-a033dea59c89 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61933) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:58:32 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-e9405556-4468-4ce8-93be-a033dea59c89 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ee241cb-0eeb-4aa3-ab54-89427b437a3a" status: 200 len: 1565 microversion: 2.1 time: 0.215723 Apr 14 17:58:32 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 383/1154] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:58:31 2023] GET /compute/v2.1/servers/7ee241cb-0eeb-4aa3-ab54-89427b437a3a => generated 1565 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:58:32 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [req-1ef69a71-99e1-4723-8aa5-af9a4fa05e4c req-0cf05eef-7fee-4049-8a5f-3806c5d98de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee241cb-0eeb-4aa3-ab54-89427b437a3a", "tag": "90bb3866-d29e-4bcb-8927-e5536e59715e"}]} {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:58:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-1ef69a71-99e1-4723-8aa5-af9a4fa05e4c req-0cf05eef-7fee-4049-8a5f-3806c5d98de3 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:58:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-1ef69a71-99e1-4723-8aa5-af9a4fa05e4c req-0cf05eef-7fee-4049-8a5f-3806c5d98de3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:58:32 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [req-1ef69a71-99e1-4723-8aa5-af9a4fa05e4c req-0cf05eef-7fee-4049-8a5f-3806c5d98de3 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:58:32 user devstack@n-api.service[61935]: INFO nova.api.openstack.compute.server_external_events [req-1ef69a71-99e1-4723-8aa5-af9a4fa05e4c req-0cf05eef-7fee-4049-8a5f-3806c5d98de3 service nova] Creating event network-changed:90bb3866-d29e-4bcb-8927-e5536e59715e for instance 7ee241cb-0eeb-4aa3-ab54-89427b437a3a on user Apr 14 17:58:32 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [req-1ef69a71-99e1-4723-8aa5-af9a4fa05e4c req-0cf05eef-7fee-4049-8a5f-3806c5d98de3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035801 Apr 14 17:58:32 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 388/1155] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:58:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:58:33 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-5f006b87-e961-418d-b8c4-954905162e0d req-a9d6b44f-10ea-4565-9389-c533efc22e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee241cb-0eeb-4aa3-ab54-89427b437a3a", "name": "network-vif-deleted", "tag": "90bb3866-d29e-4bcb-8927-e5536e59715e"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:58:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5f006b87-e961-418d-b8c4-954905162e0d req-a9d6b44f-10ea-4565-9389-c533efc22e0a service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:58:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5f006b87-e961-418d-b8c4-954905162e0d req-a9d6b44f-10ea-4565-9389-c533efc22e0a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:58:33 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-5f006b87-e961-418d-b8c4-954905162e0d req-a9d6b44f-10ea-4565-9389-c533efc22e0a service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:58:33 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-5f006b87-e961-418d-b8c4-954905162e0d req-a9d6b44f-10ea-4565-9389-c533efc22e0a service nova] Creating event network-vif-deleted:90bb3866-d29e-4bcb-8927-e5536e59715e for instance 7ee241cb-0eeb-4aa3-ab54-89427b437a3a on user Apr 14 17:58:33 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-5f006b87-e961-418d-b8c4-954905162e0d req-a9d6b44f-10ea-4565-9389-c533efc22e0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045058 Apr 14 17:58:33 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 385/1156] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:58:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:58:34 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee241cb-0eeb-4aa3-ab54-89427b437a3a", "name": "network-vif-unplugged", "status": "completed", "tag": "90bb3866-d29e-4bcb-8927-e5536e59715e"}, {"server_uuid": "7ee241cb-0eeb-4aa3-ab54-89427b437a3a", "name": "network-vif-plugged", "status": "completed", "tag": "90bb3866-d29e-4bcb-8927-e5536e59715e"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:58:34 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:58:34 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:58:34 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:58:34 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] Creating event network-vif-unplugged:90bb3866-d29e-4bcb-8927-e5536e59715e for instance 7ee241cb-0eeb-4aa3-ab54-89427b437a3a on user Apr 14 17:58:34 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] Creating event network-vif-plugged:90bb3866-d29e-4bcb-8927-e5536e59715e for instance 7ee241cb-0eeb-4aa3-ab54-89427b437a3a on user Apr 14 17:58:34 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-80d2ce4c-63a1-463b-b1da-b5d207dd29db req-b0fbb637-12f9-441a-b2f1-2a1bc9248c39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030883 Apr 14 17:58:34 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 384/1157] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:58:34 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:59:22 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:59:22 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:59:22 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-729b9d2f-63eb-41a7-ac9b-4134e7d46d20 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:59:22 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-729b9d2f-63eb-41a7-ac9b-4134e7d46d20 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7ee241cb-0eeb-4aa3-ab54-89427b437a3a] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:59:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-729b9d2f-63eb-41a7-ac9b-4134e7d46d20 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:59:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-729b9d2f-63eb-41a7-ac9b-4134e7d46d20 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:59:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-729b9d2f-63eb-41a7-ac9b-4134e7d46d20 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:59:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-729b9d2f-63eb-41a7-ac9b-4134e7d46d20 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:59:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-729b9d2f-63eb-41a7-ac9b-4134e7d46d20 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:59:22 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-729b9d2f-63eb-41a7-ac9b-4134e7d46d20 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:59:22 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-729b9d2f-63eb-41a7-ac9b-4134e7d46d20 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HTTP exception thrown: Instance 7ee241cb-0eeb-4aa3-ab54-89427b437a3a could not be found. Apr 14 17:59:22 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-729b9d2f-63eb-41a7-ac9b-4134e7d46d20 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Request method failure captured: Apr 14 17:59:22 user devstack@n-api.service[61935]: request: GET /compute/v2.1/servers/7ee241cb-0eeb-4aa3-ab54-89427b437a3a HTTP/1.1 Apr 14 17:59:22 user devstack@n-api.service[61935]: Accept: application/json Apr 14 17:59:22 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 17:59:22 user devstack@n-api.service[61935]: Connection: close Apr 14 17:59:22 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 17:59:22 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 17:59:22 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 17:59:22 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 17:59:22 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 17:59:22 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOZCsNb-viKhmBQ0HTiDifBqh5pX9pTC7XXLbMHQf-psdXdwKMA4ha5ApiLG_rkKgNSVLjM5Js1w69j2ZXhPiTzXOXnuQKiD7xw7W1JnnTHt4G55p3wmQ_mkyhqbIrEl5ejyE-ni76X7010TLMaLpG_vmjlgnfxdI3G4x1tRXanWnagA Apr 14 17:59:22 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 17:59:22 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 17:59:22 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 17:59:22 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 17:59:22 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 17:59:22 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 17:59:22 user devstack@n-api.service[61935]: X-Project-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:59:22 user devstack@n-api.service[61935]: X-Project-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:59:22 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 17:59:22 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 17:59:22 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/47e868622506423e80b158e7bf60c561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 17:59:22 user devstack@n-api.service[61935]: X-Tenant: tempest-TestVolumeBootPattern-725648218 Apr 14 17:59:22 user devstack@n-api.service[61935]: X-Tenant-Id: 47e868622506423e80b158e7bf60c561 Apr 14 17:59:22 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 17:59:22 user devstack@n-api.service[61935]: X-User: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:59:22 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 17:59:22 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 17:59:22 user devstack@n-api.service[61935]: X-User-Id: f86537c1b58843d399db6cec00012c50 Apr 14 17:59:22 user devstack@n-api.service[61935]: X-User-Name: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 17:59:22 user devstack@n-api.service[61935]: method: > Apr 14 17:59:22 user devstack@n-api.service[61935]: exception: Instance 7ee241cb-0eeb-4aa3-ab54-89427b437a3a could not be found. Apr 14 17:59:22 user devstack@n-api.service[61935]: action_args: {'id': '7ee241cb-0eeb-4aa3-ab54-89427b437a3a'} Apr 14 17:59:22 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee241cb-0eeb-4aa3-ab54-89427b437a3a could not be found. Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee241cb-0eeb-4aa3-ab54-89427b437a3a could not be found. Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee241cb-0eeb-4aa3-ab54-89427b437a3a could not be found. Apr 14 17:59:22 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 17:59:22 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-729b9d2f-63eb-41a7-ac9b-4134e7d46d20 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Returning 404 to user: Instance 7ee241cb-0eeb-4aa3-ab54-89427b437a3a could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 17:59:22 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-729b9d2f-63eb-41a7-ac9b-4134e7d46d20 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ee241cb-0eeb-4aa3-ab54-89427b437a3a" status: 404 len: 111 microversion: 2.1 time: 0.086222 Apr 14 17:59:22 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 389/1158] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:59:22 2023] GET /compute/v2.1/servers/7ee241cb-0eeb-4aa3-ab54-89427b437a3a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 17:59:29 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:59:29 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:59:29 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=6 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:59:29 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=14 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 17:59:29 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:59:29 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:59:29 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-f39353d6-0b50-46f8-b314-febd78ec87d1 req-474c93bf-5f86-420a-be6c-509ff49dbdb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a094ec7-baee-4f61-99e1-33e1e45e6fda", "tag": "b4433608-caeb-4871-adcd-2dd00c74035f"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:59:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:59:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:59:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:59:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:59:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:59:29 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:59:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-f39353d6-0b50-46f8-b314-febd78ec87d1 req-474c93bf-5f86-420a-be6c-509ff49dbdb5 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:59:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-f39353d6-0b50-46f8-b314-febd78ec87d1 req-474c93bf-5f86-420a-be6c-509ff49dbdb5 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:59:29 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-f39353d6-0b50-46f8-b314-febd78ec87d1 req-474c93bf-5f86-420a-be6c-509ff49dbdb5 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:59:29 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-f39353d6-0b50-46f8-b314-febd78ec87d1 req-474c93bf-5f86-420a-be6c-509ff49dbdb5 service nova] Creating event network-changed:b4433608-caeb-4871-adcd-2dd00c74035f for instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda on user Apr 14 17:59:29 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-f39353d6-0b50-46f8-b314-febd78ec87d1 req-474c93bf-5f86-420a-be6c-509ff49dbdb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040150 Apr 14 17:59:29 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 385/1159] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:59:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:59:29 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Going to try to terminate instance {{(pid=61934) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 17:59:29 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-f7464b19-550a-4924-b580-5046c395a043 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7a094ec7-baee-4f61-99e1-33e1e45e6fda" status: 204 len: 0 microversion: 2.1 time: 0.132347 Apr 14 17:59:29 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 386/1160] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 17:59:29 2023] DELETE /compute/v2.1/servers/7a094ec7-baee-4f61-99e1-33e1e45e6fda => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 17:59:29 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-7096c55d-e6a4-447c-973c-73cbfb23ccb8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 17:59:29 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-7096c55d-e6a4-447c-973c-73cbfb23ccb8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 17:59:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7096c55d-e6a4-447c-973c-73cbfb23ccb8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:59:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7096c55d-e6a4-447c-973c-73cbfb23ccb8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:59:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7096c55d-e6a4-447c-973c-73cbfb23ccb8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:59:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7096c55d-e6a4-447c-973c-73cbfb23ccb8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:59:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7096c55d-e6a4-447c-973c-73cbfb23ccb8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:59:29 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-7096c55d-e6a4-447c-973c-73cbfb23ccb8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:59:29 user devstack@n-api.service[61935]: DEBUG nova.policy [None req-7096c55d-e6a4-447c-973c-73cbfb23ccb8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86537c1b58843d399db6cec00012c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e868622506423e80b158e7bf60c561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61935) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 17:59:29 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-7096c55d-e6a4-447c-973c-73cbfb23ccb8 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a094ec7-baee-4f61-99e1-33e1e45e6fda" status: 200 len: 1566 microversion: 2.1 time: 0.266793 Apr 14 17:59:29 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 390/1161] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 17:59:29 2023] GET /compute/v2.1/servers/7a094ec7-baee-4f61-99e1-33e1e45e6fda => generated 1566 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 17:59:31 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a094ec7-baee-4f61-99e1-33e1e45e6fda", "name": "network-vif-unplugged", "status": "completed", "tag": "b4433608-caeb-4871-adcd-2dd00c74035f"}, {"server_uuid": "7a094ec7-baee-4f61-99e1-33e1e45e6fda", "name": "network-vif-plugged", "status": "completed", "tag": "b4433608-caeb-4871-adcd-2dd00c74035f"}]} {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:59:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:59:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:59:31 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:59:31 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] Creating event network-vif-unplugged:b4433608-caeb-4871-adcd-2dd00c74035f for instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda on user Apr 14 17:59:31 user devstack@n-api.service[61933]: INFO nova.api.openstack.compute.server_external_events [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] Creating event network-vif-plugged:b4433608-caeb-4871-adcd-2dd00c74035f for instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda on user Apr 14 17:59:31 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [req-d6fa297b-7e34-4978-9aa0-d35e9d4c3f7b req-58697a31-991f-4112-8fbc-bd3cf9d62bca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.036673 Apr 14 17:59:31 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 386/1162] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:59:31 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 17:59:31 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [req-ed2534d4-35b1-4698-866f-8eab1fd329e4 req-850a7114-530d-4978-ad82-56b5e3cda9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a094ec7-baee-4f61-99e1-33e1e45e6fda", "name": "network-vif-deleted", "tag": "b4433608-caeb-4871-adcd-2dd00c74035f"}]} {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 17:59:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ed2534d4-35b1-4698-866f-8eab1fd329e4 req-850a7114-530d-4978-ad82-56b5e3cda9b1 service nova] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 17:59:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ed2534d4-35b1-4698-866f-8eab1fd329e4 req-850a7114-530d-4978-ad82-56b5e3cda9b1 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 17:59:31 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [req-ed2534d4-35b1-4698-866f-8eab1fd329e4 req-850a7114-530d-4978-ad82-56b5e3cda9b1 service nova] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 17:59:31 user devstack@n-api.service[61934]: INFO nova.api.openstack.compute.server_external_events [req-ed2534d4-35b1-4698-866f-8eab1fd329e4 req-850a7114-530d-4978-ad82-56b5e3cda9b1 service nova] Creating event network-vif-deleted:b4433608-caeb-4871-adcd-2dd00c74035f for instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda on user Apr 14 17:59:31 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [req-ed2534d4-35b1-4698-866f-8eab1fd329e4 req-850a7114-530d-4978-ad82-56b5e3cda9b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133575 Apr 14 17:59:31 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 387/1163] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 17:59:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:00:19 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-d287916e-c106-43e8-80bd-51452cbb6f24 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:00:19 user devstack@n-api.service[61935]: DEBUG nova.compute.api [None req-d287916e-c106-43e8-80bd-51452cbb6f24 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: 7a094ec7-baee-4f61-99e1-33e1e45e6fda] Fetching instance by UUID {{(pid=61935) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:00:19 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_api:SELECT=4 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:00:19 user devstack@n-api.service[61935]: DEBUG dbcounter [-] [61935] Writing DB stats nova_cell1:SELECT=8 {{(pid=61935) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:00:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d287916e-c106-43e8-80bd-51452cbb6f24 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:00:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d287916e-c106-43e8-80bd-51452cbb6f24 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:00:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d287916e-c106-43e8-80bd-51452cbb6f24 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:00:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d287916e-c106-43e8-80bd-51452cbb6f24 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:00:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d287916e-c106-43e8-80bd-51452cbb6f24 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:00:19 user devstack@n-api.service[61935]: DEBUG oslo_concurrency.lockutils [None req-d287916e-c106-43e8-80bd-51452cbb6f24 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61935) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:00:19 user devstack@n-api.service[61935]: INFO nova.api.openstack.wsgi [None req-d287916e-c106-43e8-80bd-51452cbb6f24 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HTTP exception thrown: Instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda could not be found. Apr 14 18:00:19 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-d287916e-c106-43e8-80bd-51452cbb6f24 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Request method failure captured: Apr 14 18:00:19 user devstack@n-api.service[61935]: request: GET /compute/v2.1/servers/7a094ec7-baee-4f61-99e1-33e1e45e6fda HTTP/1.1 Apr 14 18:00:19 user devstack@n-api.service[61935]: Accept: application/json Apr 14 18:00:19 user devstack@n-api.service[61935]: Accept-Encoding: identity Apr 14 18:00:19 user devstack@n-api.service[61935]: Connection: close Apr 14 18:00:19 user devstack@n-api.service[61935]: Content-Length: 0 Apr 14 18:00:19 user devstack@n-api.service[61935]: Content-Type: application/json Apr 14 18:00:19 user devstack@n-api.service[61935]: Host: 10.0.0.210 Apr 14 18:00:19 user devstack@n-api.service[61935]: Openstack-System-Scope: None Apr 14 18:00:19 user devstack@n-api.service[61935]: User-Agent: python-urllib3/1.26.15 Apr 14 18:00:19 user devstack@n-api.service[61935]: X-Auth-Token: gAAAAABkOZCsNb-viKhmBQ0HTiDifBqh5pX9pTC7XXLbMHQf-psdXdwKMA4ha5ApiLG_rkKgNSVLjM5Js1w69j2ZXhPiTzXOXnuQKiD7xw7W1JnnTHt4G55p3wmQ_mkyhqbIrEl5ejyE-ni76X7010TLMaLpG_vmjlgnfxdI3G4x1tRXanWnagA Apr 14 18:00:19 user devstack@n-api.service[61935]: X-Domain-Id: None Apr 14 18:00:19 user devstack@n-api.service[61935]: X-Domain-Name: None Apr 14 18:00:19 user devstack@n-api.service[61935]: X-Identity-Status: Confirmed Apr 14 18:00:19 user devstack@n-api.service[61935]: X-Is-Admin-Project: True Apr 14 18:00:19 user devstack@n-api.service[61935]: X-Project-Domain-Id: default Apr 14 18:00:19 user devstack@n-api.service[61935]: X-Project-Domain-Name: Default Apr 14 18:00:19 user devstack@n-api.service[61935]: X-Project-Id: 47e868622506423e80b158e7bf60c561 Apr 14 18:00:19 user devstack@n-api.service[61935]: X-Project-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 18:00:19 user devstack@n-api.service[61935]: X-Role: member,reader Apr 14 18:00:19 user devstack@n-api.service[61935]: X-Roles: member,reader Apr 14 18:00:19 user devstack@n-api.service[61935]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/47e868622506423e80b158e7bf60c561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 18:00:19 user devstack@n-api.service[61935]: X-Tenant: tempest-TestVolumeBootPattern-725648218 Apr 14 18:00:19 user devstack@n-api.service[61935]: X-Tenant-Id: 47e868622506423e80b158e7bf60c561 Apr 14 18:00:19 user devstack@n-api.service[61935]: X-Tenant-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 18:00:19 user devstack@n-api.service[61935]: X-User: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 18:00:19 user devstack@n-api.service[61935]: X-User-Domain-Id: default Apr 14 18:00:19 user devstack@n-api.service[61935]: X-User-Domain-Name: Default Apr 14 18:00:19 user devstack@n-api.service[61935]: X-User-Id: f86537c1b58843d399db6cec00012c50 Apr 14 18:00:19 user devstack@n-api.service[61935]: X-User-Name: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 18:00:19 user devstack@n-api.service[61935]: method: > Apr 14 18:00:19 user devstack@n-api.service[61935]: exception: Instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda could not be found. Apr 14 18:00:19 user devstack@n-api.service[61935]: action_args: {'id': '7a094ec7-baee-4f61-99e1-33e1e45e6fda'} Apr 14 18:00:19 user devstack@n-api.service[61935]: {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda could not be found. Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda could not be found. Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda could not be found. Apr 14 18:00:19 user devstack@n-api.service[61935]: ERROR nova.api.openstack.wsgi Apr 14 18:00:19 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-d287916e-c106-43e8-80bd-51452cbb6f24 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Returning 404 to user: Instance 7a094ec7-baee-4f61-99e1-33e1e45e6fda could not be found. {{(pid=61935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:00:19 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-d287916e-c106-43e8-80bd-51452cbb6f24 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7a094ec7-baee-4f61-99e1-33e1e45e6fda" status: 404 len: 111 microversion: 2.1 time: 0.034953 Apr 14 18:00:19 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 391/1164] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:00:19 2023] GET /compute/v2.1/servers/7a094ec7-baee-4f61-99e1-33e1e45e6fda => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:00:20 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_api:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:00:20 user devstack@n-api.service[61933]: DEBUG dbcounter [-] [61933] Writing DB stats nova_cell1:SELECT=4 {{(pid=61933) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:00:20 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-94d2eaab-f1f5-430a-81ba-2e6fbacdb067 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:00:20 user devstack@n-api.service[61933]: DEBUG nova.compute.api [None req-94d2eaab-f1f5-430a-81ba-2e6fbacdb067 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Fetching instance by UUID {{(pid=61933) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:00:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-94d2eaab-f1f5-430a-81ba-2e6fbacdb067 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:00:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-94d2eaab-f1f5-430a-81ba-2e6fbacdb067 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:00:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-94d2eaab-f1f5-430a-81ba-2e6fbacdb067 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:00:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-94d2eaab-f1f5-430a-81ba-2e6fbacdb067 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:00:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-94d2eaab-f1f5-430a-81ba-2e6fbacdb067 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:00:20 user devstack@n-api.service[61933]: DEBUG oslo_concurrency.lockutils [None req-94d2eaab-f1f5-430a-81ba-2e6fbacdb067 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61933) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:00:20 user devstack@n-api.service[61933]: INFO nova.api.openstack.wsgi [None req-94d2eaab-f1f5-430a-81ba-2e6fbacdb067 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HTTP exception thrown: Instance eb7c2884-b149-448d-b00e-35962ae3386d could not be found. Apr 14 18:00:20 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-94d2eaab-f1f5-430a-81ba-2e6fbacdb067 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Request method failure captured: Apr 14 18:00:20 user devstack@n-api.service[61933]: request: DELETE /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d HTTP/1.1 Apr 14 18:00:20 user devstack@n-api.service[61933]: Accept: application/json Apr 14 18:00:20 user devstack@n-api.service[61933]: Accept-Encoding: identity Apr 14 18:00:20 user devstack@n-api.service[61933]: Connection: close Apr 14 18:00:20 user devstack@n-api.service[61933]: Content-Length: 0 Apr 14 18:00:20 user devstack@n-api.service[61933]: Content-Type: application/json Apr 14 18:00:20 user devstack@n-api.service[61933]: Host: 10.0.0.210 Apr 14 18:00:20 user devstack@n-api.service[61933]: Openstack-System-Scope: None Apr 14 18:00:20 user devstack@n-api.service[61933]: User-Agent: python-urllib3/1.26.15 Apr 14 18:00:20 user devstack@n-api.service[61933]: X-Auth-Token: gAAAAABkOZCsNb-viKhmBQ0HTiDifBqh5pX9pTC7XXLbMHQf-psdXdwKMA4ha5ApiLG_rkKgNSVLjM5Js1w69j2ZXhPiTzXOXnuQKiD7xw7W1JnnTHt4G55p3wmQ_mkyhqbIrEl5ejyE-ni76X7010TLMaLpG_vmjlgnfxdI3G4x1tRXanWnagA Apr 14 18:00:20 user devstack@n-api.service[61933]: X-Domain-Id: None Apr 14 18:00:20 user devstack@n-api.service[61933]: X-Domain-Name: None Apr 14 18:00:20 user devstack@n-api.service[61933]: X-Identity-Status: Confirmed Apr 14 18:00:20 user devstack@n-api.service[61933]: X-Is-Admin-Project: True Apr 14 18:00:20 user devstack@n-api.service[61933]: X-Project-Domain-Id: default Apr 14 18:00:20 user devstack@n-api.service[61933]: X-Project-Domain-Name: Default Apr 14 18:00:20 user devstack@n-api.service[61933]: X-Project-Id: 47e868622506423e80b158e7bf60c561 Apr 14 18:00:20 user devstack@n-api.service[61933]: X-Project-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 18:00:20 user devstack@n-api.service[61933]: X-Role: member,reader Apr 14 18:00:20 user devstack@n-api.service[61933]: X-Roles: member,reader Apr 14 18:00:20 user devstack@n-api.service[61933]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/47e868622506423e80b158e7bf60c561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 18:00:20 user devstack@n-api.service[61933]: X-Tenant: tempest-TestVolumeBootPattern-725648218 Apr 14 18:00:20 user devstack@n-api.service[61933]: X-Tenant-Id: 47e868622506423e80b158e7bf60c561 Apr 14 18:00:20 user devstack@n-api.service[61933]: X-Tenant-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 18:00:20 user devstack@n-api.service[61933]: X-User: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 18:00:20 user devstack@n-api.service[61933]: X-User-Domain-Id: default Apr 14 18:00:20 user devstack@n-api.service[61933]: X-User-Domain-Name: Default Apr 14 18:00:20 user devstack@n-api.service[61933]: X-User-Id: f86537c1b58843d399db6cec00012c50 Apr 14 18:00:20 user devstack@n-api.service[61933]: X-User-Name: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 18:00:20 user devstack@n-api.service[61933]: method: > Apr 14 18:00:20 user devstack@n-api.service[61933]: exception: Instance eb7c2884-b149-448d-b00e-35962ae3386d could not be found. Apr 14 18:00:20 user devstack@n-api.service[61933]: action_args: {'id': 'eb7c2884-b149-448d-b00e-35962ae3386d'} Apr 14 18:00:20 user devstack@n-api.service[61933]: {{(pid=61933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb7c2884-b149-448d-b00e-35962ae3386d could not be found. Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb7c2884-b149-448d-b00e-35962ae3386d could not be found. Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb7c2884-b149-448d-b00e-35962ae3386d could not be found. Apr 14 18:00:20 user devstack@n-api.service[61933]: ERROR nova.api.openstack.wsgi Apr 14 18:00:20 user devstack@n-api.service[61933]: DEBUG nova.api.openstack.wsgi [None req-94d2eaab-f1f5-430a-81ba-2e6fbacdb067 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Returning 404 to user: Instance eb7c2884-b149-448d-b00e-35962ae3386d could not be found. {{(pid=61933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:00:20 user devstack@n-api.service[61933]: INFO nova.api.openstack.requestlog [None req-94d2eaab-f1f5-430a-81ba-2e6fbacdb067 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d" status: 404 len: 111 microversion: 2.1 time: 0.046021 Apr 14 18:00:20 user devstack@n-api.service[61933]: [pid: 61933|app: 0|req: 387/1165] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:00:20 2023] DELETE /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:00:20 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:00:20 user devstack@n-api.service[61934]: DEBUG dbcounter [-] [61934] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61934) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:00:20 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a9c2f6ce-1460-459a-951d-6bdbd7c7f724 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '>' {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:00:20 user devstack@n-api.service[61934]: DEBUG nova.compute.api [None req-a9c2f6ce-1460-459a-951d-6bdbd7c7f724 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] [instance: eb7c2884-b149-448d-b00e-35962ae3386d] Fetching instance by UUID {{(pid=61934) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:00:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a9c2f6ce-1460-459a-951d-6bdbd7c7f724 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:00:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a9c2f6ce-1460-459a-951d-6bdbd7c7f724 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:00:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a9c2f6ce-1460-459a-951d-6bdbd7c7f724 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:00:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a9c2f6ce-1460-459a-951d-6bdbd7c7f724 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Acquiring lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:00:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a9c2f6ce-1460-459a-951d-6bdbd7c7f724 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:00:20 user devstack@n-api.service[61934]: DEBUG oslo_concurrency.lockutils [None req-a9c2f6ce-1460-459a-951d-6bdbd7c7f724 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Lock "7a7c8f85-b2ce-475a-b45c-dad157cd20d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61934) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:00:20 user devstack@n-api.service[61934]: INFO nova.api.openstack.wsgi [None req-a9c2f6ce-1460-459a-951d-6bdbd7c7f724 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] HTTP exception thrown: Instance eb7c2884-b149-448d-b00e-35962ae3386d could not be found. Apr 14 18:00:20 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a9c2f6ce-1460-459a-951d-6bdbd7c7f724 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Request method failure captured: Apr 14 18:00:20 user devstack@n-api.service[61934]: request: GET /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d HTTP/1.1 Apr 14 18:00:20 user devstack@n-api.service[61934]: Accept: application/json Apr 14 18:00:20 user devstack@n-api.service[61934]: Accept-Encoding: identity Apr 14 18:00:20 user devstack@n-api.service[61934]: Connection: close Apr 14 18:00:20 user devstack@n-api.service[61934]: Content-Length: 0 Apr 14 18:00:20 user devstack@n-api.service[61934]: Content-Type: application/json Apr 14 18:00:20 user devstack@n-api.service[61934]: Host: 10.0.0.210 Apr 14 18:00:20 user devstack@n-api.service[61934]: Openstack-System-Scope: None Apr 14 18:00:20 user devstack@n-api.service[61934]: User-Agent: python-urllib3/1.26.15 Apr 14 18:00:20 user devstack@n-api.service[61934]: X-Auth-Token: gAAAAABkOZCsNb-viKhmBQ0HTiDifBqh5pX9pTC7XXLbMHQf-psdXdwKMA4ha5ApiLG_rkKgNSVLjM5Js1w69j2ZXhPiTzXOXnuQKiD7xw7W1JnnTHt4G55p3wmQ_mkyhqbIrEl5ejyE-ni76X7010TLMaLpG_vmjlgnfxdI3G4x1tRXanWnagA Apr 14 18:00:20 user devstack@n-api.service[61934]: X-Domain-Id: None Apr 14 18:00:20 user devstack@n-api.service[61934]: X-Domain-Name: None Apr 14 18:00:20 user devstack@n-api.service[61934]: X-Identity-Status: Confirmed Apr 14 18:00:20 user devstack@n-api.service[61934]: X-Is-Admin-Project: True Apr 14 18:00:20 user devstack@n-api.service[61934]: X-Project-Domain-Id: default Apr 14 18:00:20 user devstack@n-api.service[61934]: X-Project-Domain-Name: Default Apr 14 18:00:20 user devstack@n-api.service[61934]: X-Project-Id: 47e868622506423e80b158e7bf60c561 Apr 14 18:00:20 user devstack@n-api.service[61934]: X-Project-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 18:00:20 user devstack@n-api.service[61934]: X-Role: member,reader Apr 14 18:00:20 user devstack@n-api.service[61934]: X-Roles: member,reader Apr 14 18:00:20 user devstack@n-api.service[61934]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/47e868622506423e80b158e7bf60c561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/47e868622506423e80b158e7bf60c561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 18:00:20 user devstack@n-api.service[61934]: X-Tenant: tempest-TestVolumeBootPattern-725648218 Apr 14 18:00:20 user devstack@n-api.service[61934]: X-Tenant-Id: 47e868622506423e80b158e7bf60c561 Apr 14 18:00:20 user devstack@n-api.service[61934]: X-Tenant-Name: tempest-TestVolumeBootPattern-725648218 Apr 14 18:00:20 user devstack@n-api.service[61934]: X-User: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 18:00:20 user devstack@n-api.service[61934]: X-User-Domain-Id: default Apr 14 18:00:20 user devstack@n-api.service[61934]: X-User-Domain-Name: Default Apr 14 18:00:20 user devstack@n-api.service[61934]: X-User-Id: f86537c1b58843d399db6cec00012c50 Apr 14 18:00:20 user devstack@n-api.service[61934]: X-User-Name: tempest-TestVolumeBootPattern-725648218-project-member Apr 14 18:00:20 user devstack@n-api.service[61934]: method: > Apr 14 18:00:20 user devstack@n-api.service[61934]: exception: Instance eb7c2884-b149-448d-b00e-35962ae3386d could not be found. Apr 14 18:00:20 user devstack@n-api.service[61934]: action_args: {'id': 'eb7c2884-b149-448d-b00e-35962ae3386d'} Apr 14 18:00:20 user devstack@n-api.service[61934]: {{(pid=61934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb7c2884-b149-448d-b00e-35962ae3386d could not be found. Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb7c2884-b149-448d-b00e-35962ae3386d could not be found. Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb7c2884-b149-448d-b00e-35962ae3386d could not be found. Apr 14 18:00:20 user devstack@n-api.service[61934]: ERROR nova.api.openstack.wsgi Apr 14 18:00:20 user devstack@n-api.service[61934]: DEBUG nova.api.openstack.wsgi [None req-a9c2f6ce-1460-459a-951d-6bdbd7c7f724 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Returning 404 to user: Instance eb7c2884-b149-448d-b00e-35962ae3386d could not be found. {{(pid=61934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:00:20 user devstack@n-api.service[61934]: INFO nova.api.openstack.requestlog [None req-a9c2f6ce-1460-459a-951d-6bdbd7c7f724 tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d" status: 404 len: 111 microversion: 2.1 time: 0.045616 Apr 14 18:00:20 user devstack@n-api.service[61934]: [pid: 61934|app: 0|req: 388/1166] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:00:20 2023] GET /compute/v2.1/servers/eb7c2884-b149-448d-b00e-35962ae3386d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:00:23 user devstack@n-api.service[61935]: DEBUG nova.api.openstack.wsgi [None req-12d5059e-abeb-4594-bade-e7759cdda67d tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] Calling method '.version_select at 0x7fe19cf5b250>' {{(pid=61935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:00:23 user devstack@n-api.service[61935]: INFO nova.api.openstack.requestlog [None req-12d5059e-abeb-4594-bade-e7759cdda67d tempest-TestVolumeBootPattern-725648218 tempest-TestVolumeBootPattern-725648218-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1742880846" status: 202 len: 0 microversion: 2.1 time: 0.034496 Apr 14 18:00:23 user devstack@n-api.service[61935]: [pid: 61935|app: 0|req: 392/1167] 10.0.0.210 () {62 vars in 1340 bytes} [Fri Apr 14 18:00:23 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1742880846 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)